-- Logs begin at Thu 2022-07-21 09:29:45 UTC, end at Thu 2022-07-21 11:04:25 UTC. -- Jul 21 09:58:32.448161 dv-cinder-850618-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 09:58:32.459952 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 09:58:32 2022] *** Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: nodename: dv-cinder-850618-1-iscsi Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: machine: x86_64 Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: clock source: unix Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: pcre jit disabled Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: detected number of CPU cores: 4 Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: current working directory: / Jul 21 09:58:32.462363 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: detected binary path: /usr/bin/uwsgi-core Jul 21 09:58:32.463323 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: your processes number limit is 47680 Jul 21 09:58:32.463323 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: your memory page size is 4096 bytes Jul 21 09:58:32.463323 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: detected max file descriptor number: 2048 Jul 21 09:58:32.463323 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: lock engine: pthread robust mutexes Jul 21 09:58:32.463323 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: thunder lock: enabled Jul 21 09:58:32.463323 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 09:58:32.463323 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 09:58:32.508025 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: Python main interpreter initialized at 0x5587bd2069c0 Jul 21 09:58:32.508025 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: python threads support enabled Jul 21 09:58:32.508025 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: your server socket listen backlog is limited to 100 connections Jul 21 09:58:32.508025 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: your mercy for graceful operations on workers is 90 seconds Jul 21 09:58:32.508398 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 09:58:32.508478 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: *** Operational MODE: preforking *** Jul 21 09:58:32.508761 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: *** uWSGI is running in multiple interpreter mode *** Jul 21 09:58:32.508761 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: spawned uWSGI master process (pid: 80418) Jul 21 09:58:32.508971 dv-cinder-850618-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 21 09:58:32.510031 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: spawned uWSGI worker 1 (pid: 80423, cores: 1) Jul 21 09:58:32.510031 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: spawned uWSGI worker 2 (pid: 80424, cores: 1) Jul 21 09:58:32.510031 dv-cinder-850618-1-iscsi devstack@keystone.service[80418]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 09:58:38.156849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:58:38.156849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: from cryptography.utils import int_from_bytes Jul 21 09:58:38.158269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:58:38.158269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: from cryptography.utils import int_from_bytes Jul 21 09:58:38.158375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:58:38.158375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes Jul 21 09:58:38.158375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:58:38.158375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes Jul 21 09:58:38.209731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 09:58:38.209918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 09:58:38.210121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] command line args: [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 09:58:38.210429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 09:58:38.210609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ================================================================================ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 09:58:38.210864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.211110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_dir = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.211298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.211518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_source = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.211774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] debug = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.211863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 09:58:38.211980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.212544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 09:58:38.212657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.212755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] command line args: [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 09:58:38.212861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.212861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.213052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 09:58:38.213147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.213246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ================================================================================ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 09:58:38.213341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.213445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_config_append = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.213546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.213718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_dir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.213897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.214005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] admin_token = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.214231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.214397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config_dir = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.214512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.214746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.215118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.215263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.215384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config_source = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.215492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.215638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.215745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] debug = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.215886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.216916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217306 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_config_append = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.217896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_dir = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] publish_errors = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.218979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.219175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.219257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.219448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.219632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.219760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.220455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.220546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] standard_threads = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.220704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.220782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.220973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.221140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.221219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.221339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_journal = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.221530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_json = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.221652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.222004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_stderr = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.222186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.223520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_syslog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.223711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.223920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.223920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.224337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.224626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.224827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.225020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.225217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.225502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.225702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.225883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.225883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.226266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.226478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.226478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.226833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.226833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] publish_errors = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.227189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.227348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.227499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.227499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.227796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.227993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.228173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.228337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.228503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.228672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.228672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.229013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.229210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.229397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] standard_threads = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.229607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.229914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.230098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.230098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.230512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.230705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.230880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.231022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.231202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_journal = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.231324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.231452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_json = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.231452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_stderr = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.231675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.231795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_syslog = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.231934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.232056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:58:38.232179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.232179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.232416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.232539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.232539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.232769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.232965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.233928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.234053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.234183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.234325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.234483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.234483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.234835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.235021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.235021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.235318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.235446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.235590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.236215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.236341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.236456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.236597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.236746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.236865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.236985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.237100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.237213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.237326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.237447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.237447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.237959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.238146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.238146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.238577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.238713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.238831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.238947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.239838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.240846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.241916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.242044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.242143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.242273 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.242380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.242629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.242788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.242900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.243999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.244964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.245202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.245331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.245448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.245586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.245706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.245918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246715 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.246941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.247912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.248066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.248184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.248294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.248409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.248565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.248740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.248867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.249054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.249172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.249278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.249460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.249663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.249846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.249984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250107 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.250969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.251075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.251222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.251342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.251511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.251636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.251803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.251942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.252096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.252238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.252362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.252531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.252805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.external = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.252805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.253072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.253198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.253314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.253429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.253592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.password = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.253761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.token = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.253897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254553 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.254914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.255962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.256902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.257887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.258947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.259070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.259186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.259302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.259425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.259803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.259928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260178 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.260887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.external = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.261955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.password = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.262956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.token = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.263913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.264954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.265892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.266964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.267957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.268972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.269914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.270070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.270346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.270455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.270686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.270799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.270918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.271157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.271260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.271453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.271619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.271720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.271861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.271965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.272095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.272200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.272346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.272452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.272595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.272825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.272928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.273973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274106 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.274968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.275913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.276030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.276153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.276271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.276387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.276588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.276757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.276876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.277938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.278954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.279923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.280894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.281997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.282113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.282244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.282361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.282971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.283942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.284997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.285916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.286914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.287110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.287230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.287346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.287559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.287687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.287827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.287947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.288061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.288310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.288430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.288592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.288714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.288849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.288970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.289106 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.289303 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.289453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.289647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.289785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.289976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.290154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.290318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.290449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.290633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.290755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.290915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.291996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.292193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.292350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.292502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.292621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.292621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.292885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.293922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.294929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.295993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.296127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.296250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.296375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.296503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.296630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.296748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.296886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.297938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.298106 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.298774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.298899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.299912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.300960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.301907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.302125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.302292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.302409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.302537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.302655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.302771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.302886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.303848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.304083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.304214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.304214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.304434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.304588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 09:58:38.304729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.304896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.305179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.305524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.305776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.306040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.306325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.306600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.306844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.307105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.307414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.307674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.307940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.308199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.308440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.308680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.308909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.309148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.309386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.309634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.309872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.310129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.310406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.310646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.310888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.311131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.311379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.311615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.311855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.312089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.312338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.312586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.312814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.313056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.313353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.313614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.313886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.314137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.314401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.314643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.314879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.315115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.315350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.315584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.315941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.316092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.316297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.316523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.316771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.317007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.317248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.317478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.317755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.317955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:58:38.318248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 09:58:38.338206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.338434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.338663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.346434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.346668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.346906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.348322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.356918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.378652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.378652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.388706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.388934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.530382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.531749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.584275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.584588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.591338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.591849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.655490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.655709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.655924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.656031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.656138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.656387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.656560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.656560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.656723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.656975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.657195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.657427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.683596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.683819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.684987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.685120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.685339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.685555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.697888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.702130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.711687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.711921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.712111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.712391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.712610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.712819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.713064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.718664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.718898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.719130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.719396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.719698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.719971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.720195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:58:38.731476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.731664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:58:38.732009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.732205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:58:38.732510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.732826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.733089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.733352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.736124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.736341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:58:38.736682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.736884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:58:38.737158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.737424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.737684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.737940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.745914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.746130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.746419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.746699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.754314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.754712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.755060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.755719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.755898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.759483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.759757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.760039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.760481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.760772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.761098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.761370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.761642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.761911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.762196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.762471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.764446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.767912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.768195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.768487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.768892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.769181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.769447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.769723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.770006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.770320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.772575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.773163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.790715 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.792419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.792763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.798767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.799040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.799316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.804699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.806652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.806935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.808685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.808969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.811824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.812190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.812475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.812757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.813030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.813304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.813568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.814414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.816552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.816842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.817498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.826080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.826405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.835280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.835422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.835577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.835664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.835957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.836252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.836531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.836912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.837374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.837824 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.840713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.844407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.844704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.851104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.854905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.858872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.859196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.859358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.859483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.859609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.859941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.859941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.860303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.865787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.871480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.871867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.879370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.881621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.882033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.882339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.882648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.884423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.889068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.889371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.889655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.889976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.890343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.890552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.891284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.893692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.894315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.897408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.897699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.897953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.898252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.898529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.913002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.913002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.913900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.913900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.914331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.914331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.914331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.914753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.914753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.915002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.915270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.921845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.923884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.923884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.927098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.927380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.927671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.927963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.928237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.935820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.939711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.943420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.945040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.945618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.946100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.946586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.946858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.947025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.947147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.947402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.947496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.947878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.948348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.955625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.958672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.962047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.962352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.962641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.962910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.972493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.972780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.973057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.973936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.977269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.980626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.981039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.981315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.981591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.981865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.982912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.982912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.983886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.984689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.984766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.985037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.985268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.993230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.995046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:38.998452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.998730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.999131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:38.999548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.010822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:39.011118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.011391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.020746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:58:39.021088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.021376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.021858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.022327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.022640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.022987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.023310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.023667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.023945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.024232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.024549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.024848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.025166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:58:39.025792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5587bd2069c0 pid: 80423 (default app) Jul 21 09:58:39.029991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a2eab-3b51-4c19-91af-e50296615ef4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:39.030494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a2eab-3b51-4c19-91af-e50296615ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:39.030821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a2eab-3b51-4c19-91af-e50296615ef4 None None] PATH_INFO: `/v3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:39.036135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Thu Jul 21 09:58:39 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:39.070035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5587bd2069c0 pid: 80424 (default app) Jul 21 09:58:46.940208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4987-5b16-4632-a716-4e5965990aad None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:46.940770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4987-5b16-4632-a716-4e5965990aad None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:46.940770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4987-5b16-4632-a716-4e5965990aad None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:46.942086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:46.949636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:46.950066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:46.950218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:47.019739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: INFO dbcounter [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] Registered counter for database keystone Jul 21 09:58:47.041304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 09:58:47.048340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writer thread running {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 09:58:47.228455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG passlib.handlers.bcrypt [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80424) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 09:58:47.228791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG passlib.handlers.bcrypt [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80424) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 09:58:47.285104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:47.286751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:47.408794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 09:58:47.579907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4987-5b16-4632-a716-4e5965990aad None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:47.655962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: INFO dbcounter [None req-80ac4987-5b16-4632-a716-4e5965990aad None None] Registered counter for database keystone Jul 21 09:58:47.676582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG oslo_db.sqlalchemy.engines [None req-80ac4987-5b16-4632-a716-4e5965990aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 09:58:47.683469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writer thread running {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 09:58:47.803772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4987-5b16-4632-a716-4e5965990aad None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:47.808180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb63abb-a7d3-49e7-9b69-6cbd4664537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:47.808839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb63abb-a7d3-49e7-9b69-6cbd4664537a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:47.809127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb63abb-a7d3-49e7-9b69-6cbd4664537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:47.809407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb63abb-a7d3-49e7-9b69-6cbd4664537a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:47.818100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb63abb-a7d3-49e7-9b69-6cbd4664537a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:47.871378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8cb63abb-a7d3-49e7-9b69-6cbd4664537a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 09:58:47.871724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb63abb-a7d3-49e7-9b69-6cbd4664537a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:47.884740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Jul 21 09:58:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:58:47.891105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:47.909013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a42b0-c504-49f2-a8b3-4a2bef95d21e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:47.913893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d646b-24ef-4af6-a25a-f98374db70e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:47.915067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d646b-24ef-4af6-a25a-f98374db70e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:47.915360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d646b-24ef-4af6-a25a-f98374db70e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:47.915639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d646b-24ef-4af6-a25a-f98374db70e0 admin admin] PATH_INFO: `/v3/projects/639c2ba687ad420a81f045d494e495c1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:47.917141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d646b-24ef-4af6-a25a-f98374db70e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=639c2ba687ad420a81f045d494e495c1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:47.969752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fc6d646b-24ef-4af6-a25a-f98374db70e0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 09:58:47.970477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d646b-24ef-4af6-a25a-f98374db70e0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:47.975054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Jul 21 09:58:47 2022] GET /identity/v3/projects/639c2ba687ad420a81f045d494e495c1 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:50.041130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb26f0-36d2-4a46-b8eb-89ac614e5223 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:50.041658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb26f0-36d2-4a46-b8eb-89ac614e5223 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:50.042048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb26f0-36d2-4a46-b8eb-89ac614e5223 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:50.047475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 4/6] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:50.053327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4799c-d5a9-42bc-8a9a-fd375f79bd7d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:50.053803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4799c-d5a9-42bc-8a9a-fd375f79bd7d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:50.053886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4799c-d5a9-42bc-8a9a-fd375f79bd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:50.073553 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e6a4799c-d5a9-42bc-8a9a-fd375f79bd7d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:50.075175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e6a4799c-d5a9-42bc-8a9a-fd375f79bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:50.084014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 09:58:50.107333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb26f0-36d2-4a46-b8eb-89ac614e5223 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:50.120357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb26f0-36d2-4a46-b8eb-89ac614e5223 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:50.124873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a4437-b7c1-48e7-a31f-8613f2913af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:50.125552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a4437-b7c1-48e7-a31f-8613f2913af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:50.126423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a4437-b7c1-48e7-a31f-8613f2913af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:50.126714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a4437-b7c1-48e7-a31f-8613f2913af6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:50.136447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a4437-b7c1-48e7-a31f-8613f2913af6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:50.138421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a4437-b7c1-48e7-a31f-8613f2913af6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:50.149542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Jul 21 09:58:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:58:50.155836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4799c-d5a9-42bc-8a9a-fd375f79bd7d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:50.166188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4799c-d5a9-42bc-8a9a-fd375f79bd7d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:50.170750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffe9a9-2aab-4a80-8297-a0c6d3d0ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:50.171668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe9a9-2aab-4a80-8297-a0c6d3d0ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:50.171955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe9a9-2aab-4a80-8297-a0c6d3d0ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:50.172236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe9a9-2aab-4a80-8297-a0c6d3d0ca45 admin admin] PATH_INFO: `/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:50.173727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffe9a9-2aab-4a80-8297-a0c6d3d0ca45 admin admin] RBAC: Authorizing `identity:get_user(user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:50.175662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffe9a9-2aab-4a80-8297-a0c6d3d0ca45 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:50.177380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 4/9] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Jul 21 09:58:50 2022] GET /identity/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:52.353494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ccc8f-e81c-4c7b-a6a2-08ac82cbd5c2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:52.354676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ccc8f-e81c-4c7b-a6a2-08ac82cbd5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:52.354676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ccc8f-e81c-4c7b-a6a2-08ac82cbd5c2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:52.356169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:58:52.362914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcbeb2-6b32-4893-bda9-2eb91116ae78 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:52.363429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcbeb2-6b32-4893-bda9-2eb91116ae78 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:52.363508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcbeb2-6b32-4893-bda9-2eb91116ae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:52.380838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-93bcbeb2-6b32-4893-bda9-2eb91116ae78 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:52.382133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93bcbeb2-6b32-4893-bda9-2eb91116ae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:52.425581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b658-a287-4391-a9ce-fb2ffb7e7168 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:52.425837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b658-a287-4391-a9ce-fb2ffb7e7168 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:52.425989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b658-a287-4391-a9ce-fb2ffb7e7168 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:52.427443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 7/11] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:58:52.433298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:52.433587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:52.433868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:52.476389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80423) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 09:58:52.476829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80423) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 09:58:52.477744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:58:52.504901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcbeb2-6b32-4893-bda9-2eb91116ae78 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:52.523152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:52.524818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:52.539579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:52.643272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcbeb2-6b32-4893-bda9-2eb91116ae78 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:52.643510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:58:52.666028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:52.684009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:52.684641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:52.684934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:52.685266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:52.700628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:58:52.712951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:58:52.714091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:58:52.715304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:58:52.720602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:52.809404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1c97e-7e82-44e7-9448-bc488bd2ce8f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:52.812647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:52.818875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:52.842044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dece9-cc4d-4b7d-9ef6-b33ceec7c5d3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:52.863432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:52.864364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:52.864653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:52.864932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:52.880473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:52.881173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:52.881466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:52.881752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:52.882592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:58:52.882912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:52.884363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:52.897353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:58:52.903232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:52.945323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:52.946882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:53.022635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023425b-54bc-477b-bcce-f08d01cfa70b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:53.063287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:53.064660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:53.064949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:53.065226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] PATH_INFO: `/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:53.065859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:58:53.066856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:53.068420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:53.070083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:58:52 2022] GET /identity/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:58:53.071711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:53.074723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:53.075436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:53.094694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:53.179166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b660f-2319-4a9f-ae8c-6d1a015dc14f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:53.204243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0350-8bc5-4b62-8938-cd387a132f93 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:53.216924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:53.217746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:53.218033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:53.218360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:53.241032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:53.242215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:53.242634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:53.243030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:53.243317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:53.243593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:53.244840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:53.246427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:53.248064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:58:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:58:53.253839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:58:53.264774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:58:53.266264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:58:53.267049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:58:53.267049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:58:53.267049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:58:53.267049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:58:53.267049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:58:53.271737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:53.329168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:53.349528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:53.371028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73f01e-6b6d-4269-a329-ff4f03031674 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:53.376604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c6c46-5fcf-4c45-94bb-d9578c3b0085 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:53.408151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b4818-2af3-4bd0-9799-192f749f4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:53.408818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4818-2af3-4bd0-9799-192f749f4dfe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:53.409102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4818-2af3-4bd0-9799-192f749f4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:53.409375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4818-2af3-4bd0-9799-192f749f4dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:53.410235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b4818-2af3-4bd0-9799-192f749f4dfe None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.domain.id=default, user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:58:53.410430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a326840-cbcb-48ae-a4e5-dc345fac88f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:53.410547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b4818-2af3-4bd0-9799-192f749f4dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:53.411112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a326840-cbcb-48ae-a4e5-dc345fac88f2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:53.411403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a326840-cbcb-48ae-a4e5-dc345fac88f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:53.411686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a326840-cbcb-48ae-a4e5-dc345fac88f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:53.411989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b4818-2af3-4bd0-9799-192f749f4dfe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:53.412423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a326840-cbcb-48ae-a4e5-dc345fac88f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:58:53.412738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a326840-cbcb-48ae-a4e5-dc345fac88f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:53.414128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a326840-cbcb-48ae-a4e5-dc345fac88f2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:53.418911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Jul 21 09:58:53 2022] GET /identity/v3/role_assignments?user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d&scope.domain.id=default&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:58:53.434454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 09:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:58:55.779903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e43f-8d1e-4ce1-b1f0-a36af6778675 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:55.780932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e43f-8d1e-4ce1-b1f0-a36af6778675 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:55.781423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e43f-8d1e-4ce1-b1f0-a36af6778675 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:55.783131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:55.797165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113de54-8e3a-4367-ac22-f5e5fcb40372 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:55.798668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113de54-8e3a-4367-ac22-f5e5fcb40372 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:55.799150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113de54-8e3a-4367-ac22-f5e5fcb40372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:55.823196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6113de54-8e3a-4367-ac22-f5e5fcb40372 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:55.824766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6113de54-8e3a-4367-ac22-f5e5fcb40372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:55.928266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:58:55.963692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e43f-8d1e-4ce1-b1f0-a36af6778675 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:56.179925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e43f-8d1e-4ce1-b1f0-a36af6778675 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:56.233761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64150f-fbf1-495f-9b84-30ebe5bd70e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:56.235863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64150f-fbf1-495f-9b84-30ebe5bd70e2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.236384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64150f-fbf1-495f-9b84-30ebe5bd70e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.236870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64150f-fbf1-495f-9b84-30ebe5bd70e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.256584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64150f-fbf1-495f-9b84-30ebe5bd70e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-de64150f-fbf1-495f-9b84-30ebe5bd70e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:58:56.265000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:58:56.265861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:58:56.266661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:58:56.269073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 12/24] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:58:56.275016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113de54-8e3a-4367-ac22-f5e5fcb40372 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:56.293918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd85fd-cf2c-43bc-9dca-e4ba925ac3d7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.294614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd85fd-cf2c-43bc-9dca-e4ba925ac3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.295093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd85fd-cf2c-43bc-9dca-e4ba925ac3d7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.299094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:56.309190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16114d8e-bd8b-4a54-906a-597d63348006 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.309752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16114d8e-bd8b-4a54-906a-597d63348006 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.310256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16114d8e-bd8b-4a54-906a-597d63348006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.325061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:56.343505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-16114d8e-bd8b-4a54-906a-597d63348006 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:56.345257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-16114d8e-bd8b-4a54-906a-597d63348006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:56.385964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:56.518718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113de54-8e3a-4367-ac22-f5e5fcb40372 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:56.553133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:58:56.609231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:56.610355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.611974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16114d8e-bd8b-4a54-906a-597d63348006 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:56.616623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.617108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.625724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:58:56.628234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:56.630870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:56.666781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 13/27] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:56.672961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:56.894838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16114d8e-bd8b-4a54-906a-597d63348006 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:56.916316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472d40-3029-41af-bd0f-2d345acb8764 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:56.936825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:56.941031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:56.942113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.942575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.942999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.945895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:56.957248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:56.959002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:56.967514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee11bf6-37fd-4660-94cf-c023183bad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:56.968418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee11bf6-37fd-4660-94cf-c023183bad79 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.968702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee11bf6-37fd-4660-94cf-c023183bad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.968981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee11bf6-37fd-4660-94cf-c023183bad79 None admin] PATH_INFO: `/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.972099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee11bf6-37fd-4660-94cf-c023183bad79 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:56.973593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee11bf6-37fd-4660-94cf-c023183bad79 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:56.982205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:58:56 2022] GET /identity/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d => generated 247 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:56.982205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a02a-194f-4591-b71f-541b10269e0e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.982205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a02a-194f-4591-b71f-541b10269e0e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.982205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a02a-194f-4591-b71f-541b10269e0e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.982205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:56.982205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab9c82-5d3b-4199-89de-a848dbc319da None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.982682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab9c82-5d3b-4199-89de-a848dbc319da None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.982682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab9c82-5d3b-4199-89de-a848dbc319da None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.982682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:56.988061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eca42-18c3-4674-ab12-d374bc3671ce None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:56.988399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eca42-18c3-4674-ab12-d374bc3671ce None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:56.988688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eca42-18c3-4674-ab12-d374bc3671ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:58:56.991419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:58:56.992363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:58:56.993254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:58:56.993254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:58:56.993254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:58:56.993254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:58:56.994825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:58:56.995788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:57.011582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3d1eca42-18c3-4674-ab12-d374bc3671ce None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:57.012960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3d1eca42-18c3-4674-ab12-d374bc3671ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:57.113108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59054bd2-211b-4e63-bb45-2186d5ac3591 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:57.118261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 17/32] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:58:57.120877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9364aa-0bd7-4394-bae1-69d58c8e5a87 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.121548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9364aa-0bd7-4394-bae1-69d58c8e5a87 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.122025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9364aa-0bd7-4394-bae1-69d58c8e5a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.150916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8f9364aa-0bd7-4394-bae1-69d58c8e5a87 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:57.152540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f9364aa-0bd7-4394-bae1-69d58c8e5a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:57.167560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:57.168360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.168884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.169179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.170910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:57.173011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:57.175328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 16/33] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:58:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:57.179046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:57.262204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:57.262438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 18/34] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:58:57.262438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9364aa-0bd7-4394-bae1-69d58c8e5a87 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:57.321547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:57.336034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5026-a837-4c05-b04d-e52673199c81 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:57.386219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:57.386928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.387212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.387490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.388345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:58:57.388824 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:57.390473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:57.415371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 17/35] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 09:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:57.416866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:57.423522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9364aa-0bd7-4394-bae1-69d58c8e5a87 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:57.473283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:57.474621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.475589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.476529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.477903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:57.479569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:57.572180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d236-c387-4d75-b106-c6793453d20a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:57.588384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:57.613583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:57.614644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.614835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.615102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] PATH_INFO: `/v3/domains/default/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.617345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:57.618886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:57.638504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 19/36] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jul 21 09:58:57 2022] POST /identity/v3/roles => generated 225 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:58:57.638504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:57.755164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1361 bytes} [Thu Jul 21 09:58:57 2022] PUT /identity/v3/domains/default/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:58:57.756356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:57.801275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:57.809017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d222e1-d38d-4e2c-8f7b-e7eeba7fbabc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:57.874720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d152e1-732c-41e0-a85d-d6d3943a3868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:57.875426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d152e1-732c-41e0-a85d-d6d3943a3868 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.875757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d152e1-732c-41e0-a85d-d6d3943a3868 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.877716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d152e1-732c-41e0-a85d-d6d3943a3868 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.879019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d152e1-732c-41e0-a85d-d6d3943a3868 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:57.880496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d152e1-732c-41e0-a85d-d6d3943a3868 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:57.897583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 20/38] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jul 21 09:58:57 2022] POST /identity/v3/roles => generated 219 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:58:57.899413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a73eb-f0d0-46ab-bc00-dc48f12038ac None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.899709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a73eb-f0d0-46ab-bc00-dc48f12038ac None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.900022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a73eb-f0d0-46ab-bc00-dc48f12038ac None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.905346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 21/39] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:57.905346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b96f2-3095-4222-bf92-e2a01abe8a3d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.905346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b96f2-3095-4222-bf92-e2a01abe8a3d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.905346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b96f2-3095-4222-bf92-e2a01abe8a3d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.905346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 22/40] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:58:57.911675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedde79-31ab-45c2-8a37-48772fb482d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.911983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedde79-31ab-45c2-8a37-48772fb482d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.912262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedde79-31ab-45c2-8a37-48772fb482d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.921228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90fd45-21b8-485b-aa3c-f01b5c759c38 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:57.937452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4dedde79-31ab-45c2-8a37-48772fb482d4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:57.939369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4dedde79-31ab-45c2-8a37-48772fb482d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:57.968566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b6d0-cee0-46d5-87cd-a3036542aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:57.970560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b6d0-cee0-46d5-87cd-a3036542aec2 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:57.971078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b6d0-cee0-46d5-87cd-a3036542aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:57.972041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b6d0-cee0-46d5-87cd-a3036542aec2 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:57.973591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34b6d0-cee0-46d5-87cd-a3036542aec2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:57.975346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34b6d0-cee0-46d5-87cd-a3036542aec2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:58.025768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 19/41] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 09:58:57 2022] POST /identity/v3/projects => generated 301 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:58:58.027977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b032bb-5420-42d5-bdca-26933115886b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:58.028358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b032bb-5420-42d5-bdca-26933115886b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:58.032827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b032bb-5420-42d5-bdca-26933115886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:58.037752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 23/42] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:58:58.061249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedde79-31ab-45c2-8a37-48772fb482d4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:58.175718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:58.191222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-76b032bb-5420-42d5-bdca-26933115886b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:58:58.193062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-76b032bb-5420-42d5-bdca-26933115886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:58:58.198530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedde79-31ab-45c2-8a37-48772fb482d4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:58.221808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:58:58.238534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:58.239230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:58.239523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:58.239802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:58.240587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:58.242033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:58.285436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:58:58.285689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 24/44] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jul 21 09:58:58 2022] POST /identity/v3/roles => generated 223 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:58:58.327698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:58.453946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4de5c-d1d4-43e7-ba30-9ea1eb2530a4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:58.498620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7c3e8-5113-4644-a9ec-03ea40501d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:58.499440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c3e8-5113-4644-a9ec-03ea40501d25 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:58.499735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c3e8-5113-4644-a9ec-03ea40501d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:58.500017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c3e8-5113-4644-a9ec-03ea40501d25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:58.501356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c3e8-5113-4644-a9ec-03ea40501d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:58.502950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c3e8-5113-4644-a9ec-03ea40501d25 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:58.504825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 25/45] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:58:58.510323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b032bb-5420-42d5-bdca-26933115886b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:58:58.619045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b032bb-5420-42d5-bdca-26933115886b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:58:58.654396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acb1a3-2a7e-418e-b06c-187b865779de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:58:58.655081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acb1a3-2a7e-418e-b06c-187b865779de None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:58:58.655373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acb1a3-2a7e-418e-b06c-187b865779de None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:58:58.655656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acb1a3-2a7e-418e-b06c-187b865779de None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:58:58.656399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acb1a3-2a7e-418e-b06c-187b865779de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:58:58.658621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acb1a3-2a7e-418e-b06c-187b865779de None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:58:58.687738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 21/46] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 09:58:58 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:00.144965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01f86-ef90-45a2-ae75-4cb26293e44f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:00.145486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01f86-ef90-45a2-ae75-4cb26293e44f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:00.145730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01f86-ef90-45a2-ae75-4cb26293e44f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:00.147267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 26/47] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:00.154569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868cdd-7645-4960-82df-da0bcb45a9e6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:00.155046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868cdd-7645-4960-82df-da0bcb45a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:00.155179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868cdd-7645-4960-82df-da0bcb45a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:00.173082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9f868cdd-7645-4960-82df-da0bcb45a9e6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:00.174323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9f868cdd-7645-4960-82df-da0bcb45a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:00.176401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:00.246687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 22/48] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:00.272476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d01f86-ef90-45a2-ae75-4cb26293e44f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:00.299685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:00.440363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d01f86-ef90-45a2-ae75-4cb26293e44f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:00.478842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:00.479662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:00.479956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:00.480244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:00.494904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:00.504071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:00.504955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:00.505687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 27/49] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:00.511266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f868cdd-7645-4960-82df-da0bcb45a9e6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:00.613350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f868cdd-7645-4960-82df-da0bcb45a9e6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:00.649846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0633c-d02a-47ed-a3ad-533b66c12f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:00.650568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0633c-d02a-47ed-a3ad-533b66c12f1a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:00.650861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0633c-d02a-47ed-a3ad-533b66c12f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:00.651142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0633c-d02a-47ed-a3ad-533b66c12f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:00.651915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0633c-d02a-47ed-a3ad-533b66c12f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:00.652227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0633c-d02a-47ed-a3ad-533b66c12f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:00.653652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0633c-d02a-47ed-a3ad-533b66c12f1a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:00.659306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:00.663694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 23/50] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:00.668990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:00.755168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:00.764426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fd238-2736-4eab-ad5b-417bdea107ec None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:00.764716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fd238-2736-4eab-ad5b-417bdea107ec None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:00.764997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fd238-2736-4eab-ad5b-417bdea107ec None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:00.767019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 24/51] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:00.772261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7be5a-0249-4358-847b-a68287c51399 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:00.772553 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7be5a-0249-4358-847b-a68287c51399 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:00.772837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7be5a-0249-4358-847b-a68287c51399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:00.783149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d7da-0d69-4e87-b9eb-0e01bb361738 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:00.789388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-60f7be5a-0249-4358-847b-a68287c51399 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:00.790628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60f7be5a-0249-4358-847b-a68287c51399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:00.818603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:00.819490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:00.819777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:00.820063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] PATH_INFO: `/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:00.821429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:00.823158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:00.824978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 28/52] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:00 2022] GET /identity/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:00.830974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:00.862274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 25/53] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:00.886395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7be5a-0249-4358-847b-a68287c51399 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:01.007084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7be5a-0249-4358-847b-a68287c51399 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:01.050497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:01.051447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda818a-8408-48d2-915e-6c4ceef4c424 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:01.057019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:01.057841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:01.058126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:01.058434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:01.059679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:01.061161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:01.063631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 26/54] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:01.071088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:01.096597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:01.097406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:01.097694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:01.097976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:01.099233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:01.100704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:01.103275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 29/55] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:01.108312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:01.120939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:01.188557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0a560-a2a1-4725-8584-78efdad75397 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:01.210899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a798a7c-9d68-46cf-8d04-2adef20dab8c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:01.227320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76851b17-6efb-4f41-8694-ba8e4c878c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:01.228000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851b17-6efb-4f41-8694-ba8e4c878c9a None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:01.228289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851b17-6efb-4f41-8694-ba8e4c878c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:01.228565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851b17-6efb-4f41-8694-ba8e4c878c9a None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:01.229299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76851b17-6efb-4f41-8694-ba8e4c878c9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:01.230802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76851b17-6efb-4f41-8694-ba8e4c878c9a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:01.248244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d80566-15b1-42f0-89f1-c1838444cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:01.249087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80566-15b1-42f0-89f1-c1838444cf23 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:01.249388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80566-15b1-42f0-89f1-c1838444cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:01.249747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80566-15b1-42f0-89f1-c1838444cf23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:01.250863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d80566-15b1-42f0-89f1-c1838444cf23 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.domain.id=default, user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:01.251184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d80566-15b1-42f0-89f1-c1838444cf23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:01.252761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d80566-15b1-42f0-89f1-c1838444cf23 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:01.259802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 27/56] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Jul 21 09:59:01 2022] POST /identity/v3/projects => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:59:01.264056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 30/57] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Jul 21 09:59:01 2022] GET /identity/v3/role_assignments?user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d&scope.domain.id=default&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:03.354660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c403f-be2c-454c-8185-7dd043b95b66 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:03.355183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c403f-be2c-454c-8185-7dd043b95b66 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:03.355288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c403f-be2c-454c-8185-7dd043b95b66 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:03.356600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 28/58] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:03.362552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41695bc-6399-4f74-b452-a7bf03c20cfd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:03.362974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41695bc-6399-4f74-b452-a7bf03c20cfd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:03.363114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41695bc-6399-4f74-b452-a7bf03c20cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:03.380518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f41695bc-6399-4f74-b452-a7bf03c20cfd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:03.381726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f41695bc-6399-4f74-b452-a7bf03c20cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:03.448052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 31/59] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:03.474563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c403f-be2c-454c-8185-7dd043b95b66 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:03.528135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:03.580331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c403f-be2c-454c-8185-7dd043b95b66 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:03.614063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225116b5-0d86-490e-ac1c-fe3a69378e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:03.614806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225116b5-0d86-490e-ac1c-fe3a69378e87 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:03.615091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225116b5-0d86-490e-ac1c-fe3a69378e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:03.615369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225116b5-0d86-490e-ac1c-fe3a69378e87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:03.616553 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225116b5-0d86-490e-ac1c-fe3a69378e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:03.618005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225116b5-0d86-490e-ac1c-fe3a69378e87 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:03.619673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 29/60] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:03.626593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41695bc-6399-4f74-b452-a7bf03c20cfd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:03.629791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:03.728907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41695bc-6399-4f74-b452-a7bf03c20cfd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:03.762586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60b6c6-f2b6-4b9d-a46e-55a49cbfc699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:03.763266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b6c6-f2b6-4b9d-a46e-55a49cbfc699 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:03.763552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b6c6-f2b6-4b9d-a46e-55a49cbfc699 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:03.763831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b6c6-f2b6-4b9d-a46e-55a49cbfc699 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:03.764548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60b6c6-f2b6-4b9d-a46e-55a49cbfc699 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:03.766029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60b6c6-f2b6-4b9d-a46e-55a49cbfc699 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:03.793187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 32/61] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 09:59:03 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:07.343570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f07b-0661-43ba-b5dc-ea0890fb7941 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.345131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f07b-0661-43ba-b5dc-ea0890fb7941 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.345635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f07b-0661-43ba-b5dc-ea0890fb7941 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.347655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 30/62] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:07.356073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308927-507d-4d29-a9cf-cad342cf5e2c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.356835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308927-507d-4d29-a9cf-cad342cf5e2c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.357590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308927-507d-4d29-a9cf-cad342cf5e2c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.360376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:07.362561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882518-17b2-41a0-8246-91d9ca1ed75f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.363792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882518-17b2-41a0-8246-91d9ca1ed75f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.364341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882518-17b2-41a0-8246-91d9ca1ed75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.367604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f00274-94b2-4fa5-a6a9-aa82dbf9f1ec None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.368141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f00274-94b2-4fa5-a6a9-aa82dbf9f1ec None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.368618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f00274-94b2-4fa5-a6a9-aa82dbf9f1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.404505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e8f00274-94b2-4fa5-a6a9-aa82dbf9f1ec None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:07.405768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-51882518-17b2-41a0-8246-91d9ca1ed75f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:07.407419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e8f00274-94b2-4fa5-a6a9-aa82dbf9f1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:07.408817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-51882518-17b2-41a0-8246-91d9ca1ed75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:07.497920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 32/64] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:07.506193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c76f-a88a-4311-8eb8-c6a6f161e815 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.506808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c76f-a88a-4311-8eb8-c6a6f161e815 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.507275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c76f-a88a-4311-8eb8-c6a6f161e815 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.509271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 33/65] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:07.514259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:07.518646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 33/66] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:07.524994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b827788-e140-420e-a3b0-38e7040952f4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.525589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b827788-e140-420e-a3b0-38e7040952f4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.526060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b827788-e140-420e-a3b0-38e7040952f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.544317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882518-17b2-41a0-8246-91d9ca1ed75f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:07.555324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9b827788-e140-420e-a3b0-38e7040952f4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:07.557027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9b827788-e140-420e-a3b0-38e7040952f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:07.607392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:07.641584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 34/67] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:07.643180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b827788-e140-420e-a3b0-38e7040952f4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:07.680929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882518-17b2-41a0-8246-91d9ca1ed75f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:07.722070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:07.723421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.723918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.724457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.738331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:07.746830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:07.747692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:07.748788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 34/68] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:07.754100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:07.791601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b827788-e140-420e-a3b0-38e7040952f4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:07.816642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:07.836304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4139d-313f-4833-af38-9bea9af6f98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:07.837148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4139d-313f-4833-af38-9bea9af6f98c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.837439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4139d-313f-4833-af38-9bea9af6f98c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.837719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4139d-313f-4833-af38-9bea9af6f98c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.849708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4139d-313f-4833-af38-9bea9af6f98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ccf4139d-313f-4833-af38-9bea9af6f98c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:07.857814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:07.858927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:07.865998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd8625-fca4-475d-9478-6492d8f6b859 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.868320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd8625-fca4-475d-9478-6492d8f6b859 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.868320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd8625-fca4-475d-9478-6492d8f6b859 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.868320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 36/70] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:07.868320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd8625-fca4-475d-9478-6492d8f6b859 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:07.895131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1c1e-324c-4633-bc8f-b3a35c6b19bd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:07.945796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:07.947247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:07.948082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:07.948422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:07.948702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:07.960311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:07.968532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:07.969554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:07.970340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:07.972388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.067512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd8625-fca4-475d-9478-6492d8f6b859 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.104850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45d442-fbb9-4631-89b9-e9e14ba5f20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.105544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d442-fbb9-4631-89b9-e9e14ba5f20a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.105832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d442-fbb9-4631-89b9-e9e14ba5f20a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.106127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d442-fbb9-4631-89b9-e9e14ba5f20a None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.106969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45d442-fbb9-4631-89b9-e9e14ba5f20a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:08.107280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45d442-fbb9-4631-89b9-e9e14ba5f20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.108772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45d442-fbb9-4631-89b9-e9e14ba5f20a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.122517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:08.122517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d721d-4e8e-4f5b-b38f-09b479b84294 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.122517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d721d-4e8e-4f5b-b38f-09b479b84294 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.122517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d721d-4e8e-4f5b-b38f-09b479b84294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.130026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73405951-1d5d-48e0-b93c-8f38e7c26f37 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.139442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-de3d721d-4e8e-4f5b-b38f-09b479b84294 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:08.140688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-de3d721d-4e8e-4f5b-b38f-09b479b84294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:08.153357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:08.179619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f343e2-411d-4b69-958c-4e21e0503ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.180299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f343e2-411d-4b69-958c-4e21e0503ecd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.180584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f343e2-411d-4b69-958c-4e21e0503ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.180871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f343e2-411d-4b69-958c-4e21e0503ecd None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.181637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f343e2-411d-4b69-958c-4e21e0503ecd None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:08.181951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f343e2-411d-4b69-958c-4e21e0503ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.183409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f343e2-411d-4b69-958c-4e21e0503ecd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.192721 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:08.194277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ba0c-f5d7-46f6-9663-4ae3b22f8c08 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.194584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ba0c-f5d7-46f6-9663-4ae3b22f8c08 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.194766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ba0c-f5d7-46f6-9663-4ae3b22f8c08 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.196341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 37/74] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:08.197015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ba0c-f5d7-46f6-9663-4ae3b22f8c08 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.223135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 38/75] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:08.224024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d721d-4e8e-4f5b-b38f-09b479b84294 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.258510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:08.320593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ba0c-f5d7-46f6-9663-4ae3b22f8c08 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.335700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d721d-4e8e-4f5b-b38f-09b479b84294 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.357637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.358364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.358652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.358983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.360285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:08.360722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.362318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.371770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:08.373473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.378273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccc820-b531-4f0b-b012-845ae4f90678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.379198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccc820-b531-4f0b-b012-845ae4f90678 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.379490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccc820-b531-4f0b-b012-845ae4f90678 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.379771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccc820-b531-4f0b-b012-845ae4f90678 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.394569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccc820-b531-4f0b-b012-845ae4f90678 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.396122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccc820-b531-4f0b-b012-845ae4f90678 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.402328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 39/77] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:08.402328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedacc83-c4b0-499c-9dda-1f11bec91251 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.402328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedacc83-c4b0-499c-9dda-1f11bec91251 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.402328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedacc83-c4b0-499c-9dda-1f11bec91251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.417964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fedacc83-c4b0-499c-9dda-1f11bec91251 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:08.419264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fedacc83-c4b0-499c-9dda-1f11bec91251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:08.427830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:08.492714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:08.493968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedacc83-c4b0-499c-9dda-1f11bec91251 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.513340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3fa6f-e045-4f03-b4ac-05eb8a8aadd5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.521081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:08.553011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.553937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.554260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.554552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.555858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.557358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.559095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 39/79] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:08.560052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.614557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedacc83-c4b0-499c-9dda-1f11bec91251 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.653289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.654116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.654432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.654708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.667590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:08.669403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c9165-f298-4a74-8b25-e174c4972ad7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.671036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:08.675888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:08.676866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:08.677623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:08.678261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.709555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.710636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.711128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.711446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] PATH_INFO: `/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.712784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] RBAC: Authorizing `identity:get_user(user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.715322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.717893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:08.717893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.766803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:08.790194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa490a8e-a621-4f28-9ab4-33f2b501cdd0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.838775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.839462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.839742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.840291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.849086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2849a6b-5af5-4efc-af33-86d470662a4c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:08.894842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:08.895817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:08.896109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:08.896392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:08.897686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.899212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.900914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 41/82] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:08.905604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:08.919245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:08.920759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:08.950686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.012551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.018631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5555-1d43-48f5-baf8-ef007b243e29 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.036982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 42/83] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:09.041845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.062017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.062759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.063030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.063313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.137724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.139277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.147747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20316ec-171c-4ccd-bfaa-b46470e69bc1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.184624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.185149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.185592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.185890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.186206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.187122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:09.187539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.189148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.199274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 43/84] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:09.200521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.250602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.258932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:09.258932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.316858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b04c-8e23-48ab-b056-3636a3360249 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.357834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.358561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.358877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.359150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.374646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf02e62-8894-4c0f-8651-67978a00eb5f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.420654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.421264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.421553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.421837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.422900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.424418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.434369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.444311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.445876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.459662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 43/86] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 09:59:09 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:09.459662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.518657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.607488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363bfc-cc34-4404-8c2b-33fe625fe865 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.620762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 44/87] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:09.621409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.647593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.648494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.648777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.649057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.650374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.652561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.654496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 44/88] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:09.655084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.731522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.751422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b56c-7818-4535-9d0c-a59be54f26f4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.792058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd65454-5b2f-4a1b-b71a-61c664c0dec8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.794779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.795679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.795968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.796249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.797556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.799165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.801510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 45/89] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:09.801678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.820012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:09.836870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.837762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.838054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.838381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.839606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.841333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.843435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 45/90] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:09.844738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:09.928919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4ac1-3775-4bfb-b842-e998540d28e4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.971976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:09.973905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:09.974453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:09.975143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:09.977264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:09.979888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:09.981657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b6a11-e7b7-47c1-8f86-db0df4d65dab None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:09.982101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 46/91] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:09.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:10.016481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:10.023880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:10.024573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:10.024948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:10.025285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:10.026260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] RBAC: Adding query filter params (role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=de0861b677d84f47aa0c0c38eb090876) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:10.026650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:10.028302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:10.037058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 46/92] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/role_assignments?user.id=de0861b677d84f47aa0c0c38eb090876&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=de96e843cd68485785aad1355cbf0342 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:10.043811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:10.130053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:10.200199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf53136-268a-46a3-8982-927d1d9acdf4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:10.212306 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1c339-d530-4828-b7ed-7f9b221ea4a2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:10.253720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:10.254387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:10.254676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:10.254957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:10.255809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=de0861b677d84f47aa0c0c38eb090876) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:10.256128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:10.257640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:10.264614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 47/93] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:10 2022] GET /identity/v3/role_assignments?user.id=de0861b677d84f47aa0c0c38eb090876&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:10.265567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:10.335026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:10.335710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:10.335991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:10.336266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:10.337031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:10.410762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9410c-8e2c-4671-a576-0b1fa1e87df9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:10.465379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:10.466075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:10.466391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:10.466749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:10.467934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:10.468267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:10.472412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:10.486799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 48/94] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:10 2022] GET /identity/v3/role_assignments?user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:10.581097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:10.582714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:10.710677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:10.755204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 47/95] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:10.762657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:10.929278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018792d6-7684-4791-bfd7-19d22b387ae2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:10.964462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:10.985037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b3609-42ff-4aba-93d6-cdd5fad3b146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:10.986831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b3609-42ff-4aba-93d6-cdd5fad3b146 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:10.987199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b3609-42ff-4aba-93d6-cdd5fad3b146 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:10.987490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b3609-42ff-4aba-93d6-cdd5fad3b146 None admin] PATH_INFO: `/v3/projects/240390d19bac4e41aad28580c21364cd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:10.988839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b3609-42ff-4aba-93d6-cdd5fad3b146 None admin] RBAC: Authorizing `identity:get_project(project_id=240390d19bac4e41aad28580c21364cd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:10.990381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b3609-42ff-4aba-93d6-cdd5fad3b146 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:10.992563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 49/96] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:10 2022] GET /identity/v3/projects/240390d19bac4e41aad28580c21364cd => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:10.998586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:11.171873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c6fe-a013-4ce9-9c3e-13312b439c9d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:11.231820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4ecd5-7990-4b06-911c-6fe2ec8eefd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:11.232868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4ecd5-7990-4b06-911c-6fe2ec8eefd2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:11.233433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4ecd5-7990-4b06-911c-6fe2ec8eefd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:11.233947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4ecd5-7990-4b06-911c-6fe2ec8eefd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:11.236259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4ecd5-7990-4b06-911c-6fe2ec8eefd2 None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=240390d19bac4e41aad28580c21364cd, user.id=de0861b677d84f47aa0c0c38eb090876) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:11.236799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4ecd5-7990-4b06-911c-6fe2ec8eefd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:11.239475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4ecd5-7990-4b06-911c-6fe2ec8eefd2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:11.249502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 48/97] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:10 2022] GET /identity/v3/role_assignments?user.id=de0861b677d84f47aa0c0c38eb090876&scope.project.id=240390d19bac4e41aad28580c21364cd&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:12.705526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470f5b-3dfb-4883-850e-6a417af6b9d1 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:12.706576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470f5b-3dfb-4883-850e-6a417af6b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:12.707084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470f5b-3dfb-4883-850e-6a417af6b9d1 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:12.708671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 50/98] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:12.716766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b5af2-49bc-4785-b350-8e6bf9d5268a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:12.717702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b5af2-49bc-4785-b350-8e6bf9d5268a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:12.718202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b5af2-49bc-4785-b350-8e6bf9d5268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:12.740564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fb2b5af2-49bc-4785-b350-8e6bf9d5268a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:12.742101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fb2b5af2-49bc-4785-b350-8e6bf9d5268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:12.790497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:12.832967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:12.855692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a60b-e4be-4569-a458-f7172199db64 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:12.855989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a60b-e4be-4569-a458-f7172199db64 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:12.856291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a60b-e4be-4569-a458-f7172199db64 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:12.857830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 51/100] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:12.861128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a948a2-e5cf-470e-a523-63057f8a572d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:12.861432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a948a2-e5cf-470e-a523-63057f8a572d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:12.861718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a948a2-e5cf-470e-a523-63057f8a572d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:12.863406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976c6d-5fc7-4d91-99d7-f1d5703aeb90 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:12.863699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976c6d-5fc7-4d91-99d7-f1d5703aeb90 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:12.863979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976c6d-5fc7-4d91-99d7-f1d5703aeb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:12.875740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 50/101] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:12 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:12.876591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a948a2-e5cf-470e-a523-63057f8a572d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:12.895544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cc976c6d-5fc7-4d91-99d7-f1d5703aeb90 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:12.897484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cc976c6d-5fc7-4d91-99d7-f1d5703aeb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:13.010860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 52/102] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:13.013133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f02da-a9ec-4a33-8580-c16e6c26f8a5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.013603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f02da-a9ec-4a33-8580-c16e6c26f8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.014058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f02da-a9ec-4a33-8580-c16e6c26f8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.038251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9b1f02da-a9ec-4a33-8580-c16e6c26f8a5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:13.040971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b1f02da-a9ec-4a33-8580-c16e6c26f8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:13.121939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 53/103] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:13.123401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f02da-a9ec-4a33-8580-c16e6c26f8a5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:13.178933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a948a2-e5cf-470e-a523-63057f8a572d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:13.210634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:13.264826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f02da-a9ec-4a33-8580-c16e6c26f8a5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:13.306659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:13.307792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.308685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.309519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.311485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:13.314414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.314954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.315794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.328723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:13.338455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:13.339353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:13.340377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:13.342243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:13.343180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 54/104] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:13.344798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:13.355403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:13.356282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:13.357083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 51/105] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 480 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:13.357698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:13.464228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb538c-a562-464a-a262-4a3971271488 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:13.475768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:13.478096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:13.506421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:13.508064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.508571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.509048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.510767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:13.512632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:13.514654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 55/106] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:13.516000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:13.620811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a4f9-c6be-473c-9eec-7f9b6b839005 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:13.649804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c17ed8-b893-439e-bd7e-ef56ed555a1f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:13.661379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:13.662411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.662876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.663446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.664507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:13.665174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:13.666904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:13.676644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 52/107] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:13.677974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:13.694404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245798a-5074-46b8-bbc5-a51d7c4a5d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:13.695313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245798a-5074-46b8-bbc5-a51d7c4a5d7b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.695709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245798a-5074-46b8-bbc5-a51d7c4a5d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.696067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245798a-5074-46b8-bbc5-a51d7c4a5d7b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.697195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245798a-5074-46b8-bbc5-a51d7c4a5d7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:13.698089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245798a-5074-46b8-bbc5-a51d7c4a5d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:13.699899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245798a-5074-46b8-bbc5-a51d7c4a5d7b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:13.711739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 56/108] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:13.713980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84720c2-6b1c-425b-945a-e4344563afe5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.714434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84720c2-6b1c-425b-945a-e4344563afe5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.714864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84720c2-6b1c-425b-945a-e4344563afe5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.716692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 57/109] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:13.717598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84720c2-6b1c-425b-945a-e4344563afe5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:13.774011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:13.810410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:13.821948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfde19-83f4-4258-b782-4ceb29da7c8d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:13.852417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84720c2-6b1c-425b-945a-e4344563afe5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:13.858369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:13.859055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.859866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.860153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.860868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:13.862355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:13.902286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 53/110] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 09:59:13 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:13.902286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:13.903925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ca1c-72f8-475c-8461-8e8a5c34d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:13.905568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ca1c-72f8-475c-8461-8e8a5c34d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.906325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ca1c-72f8-475c-8461-8e8a5c34d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.906912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ca1c-72f8-475c-8461-8e8a5c34d6f1 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.908413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56ca1c-72f8-475c-8461-8e8a5c34d6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:13.910011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56ca1c-72f8-475c-8461-8e8a5c34d6f1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:13.918036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 58/111] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:13 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:13.920774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624569-4537-4797-95da-8dc061501106 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:13.921394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624569-4537-4797-95da-8dc061501106 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:13.922539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624569-4537-4797-95da-8dc061501106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:13.945773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-37624569-4537-4797-95da-8dc061501106 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:13.948202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-37624569-4537-4797-95da-8dc061501106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:14.069386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528527-caa9-4893-9653-68d4506f0497 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:14.074725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 59/112] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:14.079853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93268226-8a3d-407b-9a9b-bccd5e35f12a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.080421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93268226-8a3d-407b-9a9b-bccd5e35f12a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.080691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93268226-8a3d-407b-9a9b-bccd5e35f12a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.082453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 60/113] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:14.082938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93268226-8a3d-407b-9a9b-bccd5e35f12a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:14.135588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85792e-a3ff-4689-b4de-cacbc47ea582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:14.136558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85792e-a3ff-4689-b4de-cacbc47ea582 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.136835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85792e-a3ff-4689-b4de-cacbc47ea582 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.137113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85792e-a3ff-4689-b4de-cacbc47ea582 None admin] PATH_INFO: `/v3/users/6a9c83476c564cc68f29eae847f266d9` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.153972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:14.154670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85792e-a3ff-4689-b4de-cacbc47ea582 None admin] RBAC: Authorizing `identity:get_user(user_id=6a9c83476c564cc68f29eae847f266d9)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:14.157218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85792e-a3ff-4689-b4de-cacbc47ea582 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:14.160148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 54/114] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:13 2022] GET /identity/v3/users/6a9c83476c564cc68f29eae847f266d9 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:14.161486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2579f-c0b2-49d4-b7e6-78fc51bcc441 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.161872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2579f-c0b2-49d4-b7e6-78fc51bcc441 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.162105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2579f-c0b2-49d4-b7e6-78fc51bcc441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.167756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:14.184756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1df2579f-c0b2-49d4-b7e6-78fc51bcc441 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:14.185980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1df2579f-c0b2-49d4-b7e6-78fc51bcc441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:14.248374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93268226-8a3d-407b-9a9b-bccd5e35f12a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:14.285596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 55/115] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:14.288332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2579f-c0b2-49d4-b7e6-78fc51bcc441 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:14.297508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:14.298485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.298904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.299392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.301824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:14.303920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:14.306785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 61/116] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:14 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:14.307614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:14.425928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2579f-c0b2-49d4-b7e6-78fc51bcc441 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:14.466532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:14.475199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:14.476597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.477145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.477434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.481900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56dcfb-29a0-4b03-bff8-75432cd7de5f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:14.492560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:14.494915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:14.503892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:14.504994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 56/117] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:14.511376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:14.544790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301369b-5a93-4cd0-bb7a-0df09f1ae4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:14.545848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301369b-5a93-4cd0-bb7a-0df09f1ae4df None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.546359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301369b-5a93-4cd0-bb7a-0df09f1ae4df None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.547351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301369b-5a93-4cd0-bb7a-0df09f1ae4df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.663160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301369b-5a93-4cd0-bb7a-0df09f1ae4df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:14.665849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301369b-5a93-4cd0-bb7a-0df09f1ae4df None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:14.674880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bfad-947d-4917-bfdf-a1a4e2c79018 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:14.723768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:14.724711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.725007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.725304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b/users/de0861b677d84f47aa0c0c38eb090876/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.727621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e192fd2822654ca6913d270533f3a99b, user_id=de0861b677d84f47aa0c0c38eb090876, role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:14.729152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:14.743978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 57/118] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:14 2022] PUT /identity/v3/projects/e192fd2822654ca6913d270533f3a99b/users/de0861b677d84f47aa0c0c38eb090876/roles/de96e843cd68485785aad1355cbf0342 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:14.744536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:14.802457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 62/119] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:14.804335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba12a-c416-4ddf-a253-46408f180ad1 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.804864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba12a-c416-4ddf-a253-46408f180ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.805567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ba12a-c416-4ddf-a253-46408f180ad1 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.807197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 63/120] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:14.808006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ba12a-c416-4ddf-a253-46408f180ad1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:14.815120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:14.827950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:14.877382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7510-f002-4ae7-956b-acf8dc807bb0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:14.918081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:14.919428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:14.919721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:14.920002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:14.941935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:14.960120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:14.961672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 58/121] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:14.963013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.001366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ba12a-c416-4ddf-a253-46408f180ad1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:15.049385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b3c28-7790-4265-b7d4-87030809cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:15.050122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3c28-7790-4265-b7d4-87030809cb53 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.050461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3c28-7790-4265-b7d4-87030809cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.050740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3c28-7790-4265-b7d4-87030809cb53 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.051508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b3c28-7790-4265-b7d4-87030809cb53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:15.051818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b3c28-7790-4265-b7d4-87030809cb53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:15.053765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b3c28-7790-4265-b7d4-87030809cb53 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:15.066449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 64/122] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:15.067582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a0361-7dbb-48f5-b8fb-44b22011bc27 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.067880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a0361-7dbb-48f5-b8fb-44b22011bc27 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.068161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a0361-7dbb-48f5-b8fb-44b22011bc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.084910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb06f-fbf0-4c4a-a5d3-72aaf0ee24ab None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:15.091595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e17a0361-7dbb-48f5-b8fb-44b22011bc27 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:15.093338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e17a0361-7dbb-48f5-b8fb-44b22011bc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:15.100039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:15.129044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:15.130267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.130593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.130990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.132285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:15.133964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:15.136103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 59/123] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:14 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:15.137056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.184192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:15.192669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 65/124] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:15.198231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a0361-7dbb-48f5-b8fb-44b22011bc27 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.263778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e85f4-0ea3-4676-98d4-c025e6da46d6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:15.309885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:15.310868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.311163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.311470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.313086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:15.313411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:15.315519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:15.322154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a0361-7dbb-48f5-b8fb-44b22011bc27 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:15.327814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 60/125] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:15.329290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.380217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:15.381233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.381525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.381815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] PATH_INFO: `/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.383295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:15.384900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:15.387204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 66/126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:15 2022] GET /identity/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:15.388016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.397710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:15.505337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cff7a2-9b67-49e7-8a82-f3528ada0350 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:15.525939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:15.552052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:15.553030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.553760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.554236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.555249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] RBAC: Adding query filter params (role.id=bd5807e520da4cb190e242473e86f650, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=6a9c83476c564cc68f29eae847f266d9) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:15.556019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:15.558218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:15.565849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 61/127] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:15 2022] GET /identity/v3/role_assignments?user.id=6a9c83476c564cc68f29eae847f266d9&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=bd5807e520da4cb190e242473e86f650 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:15.567062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.591369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626025-6dc4-42f3-a52f-a60e76bbed11 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:15.656312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:15.657361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.657665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.657952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.671069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:15.679522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:15.680653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:15.681702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 67/128] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:15.682377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.715293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b1a6-815d-4971-a007-2b3d7657f115 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:15.726127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:15.764590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:15.767623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:15.768205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:15.769524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:15.772118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:15.774540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:15.780771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 62/129] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:15 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:15.788212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:15.948098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f750e-73f3-403b-99f1-1fbfe8b2386c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:16.011199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c72309-0e6d-49f3-b535-8780f37f5f22 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:16.018577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:16.046266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:16.048168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.048608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.049059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.052213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:16.054617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:16.066501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 68/130] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:15 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:16.067922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:16.119203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:16.120283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.120752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.121185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.122510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:16.123020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:16.125927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:16.156075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 63/131] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:16.157779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:16.234747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:16.276875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796beca-831f-4646-8956-53746a54ab13 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:16.313345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:16.314616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.315126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.315603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.317122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:16.318873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:16.318981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81c65-d30c-4c3c-ae8a-d38d09ecc77b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:16.321028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 69/132] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:16 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:16.322128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:16.363038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d8f3-ebee-4875-ae78-cedc7177e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:16.363959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d8f3-ebee-4875-ae78-cedc7177e95a None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.364251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d8f3-ebee-4875-ae78-cedc7177e95a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.364575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d8f3-ebee-4875-ae78-cedc7177e95a None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.367777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d8f3-ebee-4875-ae78-cedc7177e95a None admin] RBAC: Authorizing `identity:create_grant(project_id=e192fd2822654ca6913d270533f3a99b, user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:16.370100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d8f3-ebee-4875-ae78-cedc7177e95a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:16.388789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 64/133] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:16 2022] PUT /identity/v3/projects/e192fd2822654ca6913d270533f3a99b/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:16.390661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36513bf-5a94-4bf7-b89d-cff53eac9d71 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.391007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36513bf-5a94-4bf7-b89d-cff53eac9d71 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.391294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36513bf-5a94-4bf7-b89d-cff53eac9d71 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.393519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 65/134] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:16.394412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:16.394746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36513bf-5a94-4bf7-b89d-cff53eac9d71 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:16.442626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07e6b3-83a9-4f54-b091-eaaff9a67d38 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:16.486671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbc064-56ee-4214-aea6-4046675d3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:16.487962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc064-56ee-4214-aea6-4046675d3702 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.488447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc064-56ee-4214-aea6-4046675d3702 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.488922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc064-56ee-4214-aea6-4046675d3702 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.496001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbc064-56ee-4214-aea6-4046675d3702 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:16.497721 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbc064-56ee-4214-aea6-4046675d3702 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:16.499674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 70/135] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:16 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:16.501787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d973d9-4932-4223-9b05-34b2f9fb8041 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.502602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d973d9-4932-4223-9b05-34b2f9fb8041 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.503122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d973d9-4932-4223-9b05-34b2f9fb8041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.521656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a2d973d9-4932-4223-9b05-34b2f9fb8041 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:16.523342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2d973d9-4932-4223-9b05-34b2f9fb8041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:16.604699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36513bf-5a94-4bf7-b89d-cff53eac9d71 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:16.614200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:16.614384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 71/136] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:16.615347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d973d9-4932-4223-9b05-34b2f9fb8041 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:16.684804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:16.685741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.686038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.686355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b/users/de0861b677d84f47aa0c0c38eb090876/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.688589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] RBAC: Authorizing `identity:create_grant(project_id=e192fd2822654ca6913d270533f3a99b, user_id=de0861b677d84f47aa0c0c38eb090876, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:16.690081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:16.711152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 66/137] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:16 2022] PUT /identity/v3/projects/e192fd2822654ca6913d270533f3a99b/users/de0861b677d84f47aa0c0c38eb090876/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:16.712062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:16.760350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:16.816266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d973d9-4932-4223-9b05-34b2f9fb8041 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:16.864005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:16.865300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:16.866530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:16.867046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] PATH_INFO: `/v3/projects/240390d19bac4e41aad28580c21364cd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:16.868838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] RBAC: Authorizing `identity:get_project(project_id=240390d19bac4e41aad28580c21364cd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:16.870774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:16.873158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 72/138] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:16 2022] GET /identity/v3/projects/240390d19bac4e41aad28580c21364cd => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:16.884729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:17.052760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915776-0583-4b81-b880-ea7829d8aeee None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:17.078721 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ed63-34a7-4a0a-9664-b55c66577a66 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:17.114651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:17.115395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:17.115690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:17.115990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:17.117232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:17.118910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:17.120729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 67/139] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:17.122498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:17.127227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:17.133157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0d116-79f9-4290-8306-2e3ea75bafa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:17.135435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0d116-79f9-4290-8306-2e3ea75bafa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:17.136017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0d116-79f9-4290-8306-2e3ea75bafa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:17.136538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0d116-79f9-4290-8306-2e3ea75bafa6 None admin] PATH_INFO: `/v3/projects/240390d19bac4e41aad28580c21364cd/users/de0861b677d84f47aa0c0c38eb090876/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:17.139030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0d116-79f9-4290-8306-2e3ea75bafa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=240390d19bac4e41aad28580c21364cd, user_id=de0861b677d84f47aa0c0c38eb090876, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:17.141454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0d116-79f9-4290-8306-2e3ea75bafa6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:17.161357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 73/140] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:16 2022] PUT /identity/v3/projects/240390d19bac4e41aad28580c21364cd/users/de0861b677d84f47aa0c0c38eb090876/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:59:17.186581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:17.303013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf2024-90ba-4be3-80aa-2d32d391d4da None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:17.352937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeef24c-aec1-4868-8220-65f40c338c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:17.353648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeef24c-aec1-4868-8220-65f40c338c85 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:17.353939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeef24c-aec1-4868-8220-65f40c338c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:17.354281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeef24c-aec1-4868-8220-65f40c338c85 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:17.358551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeef24c-aec1-4868-8220-65f40c338c85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:17.360820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeef24c-aec1-4868-8220-65f40c338c85 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:17.396837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 68/141] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 09:59:17 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:17.795874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f388d-b111-473d-b814-738c6db9900c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:17.796587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f388d-b111-473d-b814-738c6db9900c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:17.797627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f388d-b111-473d-b814-738c6db9900c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:17.799255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 74/142] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:17.806784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078956-7ecc-47cd-ac6d-954143e29df7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:17.807379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078956-7ecc-47cd-ac6d-954143e29df7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:17.807856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078956-7ecc-47cd-ac6d-954143e29df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:17.829355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d4078956-7ecc-47cd-ac6d-954143e29df7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:17.831081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d4078956-7ecc-47cd-ac6d-954143e29df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:17.915215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 69/143] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:17.957275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f388d-b111-473d-b814-738c6db9900c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:18.076840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f388d-b111-473d-b814-738c6db9900c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:18.117639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:18.119307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:18.119795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:18.120264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:18.132592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:18.141493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:18.142377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:18.143158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:18.145569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 75/144] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:18.151641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078956-7ecc-47cd-ac6d-954143e29df7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:18.166593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:18.294377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078956-7ecc-47cd-ac6d-954143e29df7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:18.356834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fcdfe-9e3e-445c-b70f-2e73065bec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:18.357450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fcdfe-9e3e-445c-b70f-2e73065bec7f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:18.357737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fcdfe-9e3e-445c-b70f-2e73065bec7f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:18.358015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fcdfe-9e3e-445c-b70f-2e73065bec7f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:18.358829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fcdfe-9e3e-445c-b70f-2e73065bec7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:18.359168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fcdfe-9e3e-445c-b70f-2e73065bec7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:18.360587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fcdfe-9e3e-445c-b70f-2e73065bec7f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:18.371731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 70/145] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:18.380567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:18.469603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:18.485135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9a08-43d5-48e8-9fe4-748511aa2b23 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:18.485427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9a08-43d5-48e8-9fe4-748511aa2b23 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:18.485705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9a08-43d5-48e8-9fe4-748511aa2b23 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:18.487132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 71/146] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:18.495778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827a09d-1b4b-4e08-9354-31be78fab357 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:18.496063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827a09d-1b4b-4e08-9354-31be78fab357 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:18.496336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827a09d-1b4b-4e08-9354-31be78fab357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:18.525399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1827a09d-1b4b-4e08-9354-31be78fab357 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:18.528285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1827a09d-1b4b-4e08-9354-31be78fab357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:18.536153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791c449-2e54-4238-8a74-4b89cdb02f84 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:18.577873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:18.578842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:18.579182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:18.579414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:18.580829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:18.582351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:18.584343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 76/147] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:18 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:18.589645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:18.712002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 72/148] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:18.713159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977230d5-d402-4797-89e2-f3b9d8836199 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:18.734058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:18.758717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:18.759562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827a09d-1b4b-4e08-9354-31be78fab357 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:18.759718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:18.760065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:18.760412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:18.762016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:18.843808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:18.845458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:18.939136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827a09d-1b4b-4e08-9354-31be78fab357 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:18.961265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 77/149] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:59:18.968198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:18.994628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:19.003491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:19.004322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:19.004608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:19.004885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:19.026157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:19.038555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:19.039551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:19.040374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 73/150] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:19.047503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:19.088520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ce506-22a6-4025-817b-22692a68f18f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:19.154998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:19.155882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:19.156267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:19.156729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:19.158639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:19.160135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:19.165397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 78/151] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:18 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:19.171214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:19.176889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:19.262065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce961b-76c6-409c-b1f6-b8983d4680e2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:19.307115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:19.307814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:19.308100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:19.308380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:19.309159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:19.309472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:19.309848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:19.315228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:19.330212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:19.331997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cba3f6-6e3c-446d-964c-2a38336289b7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:19.336577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:19.397204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:19.398454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:19.398960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:19.399459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:19.401166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] RBAC: Adding query filter params (role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=de0861b677d84f47aa0c0c38eb090876) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:19.401736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:19.404619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:19.423019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:19 2022] GET /identity/v3/role_assignments?user.id=de0861b677d84f47aa0c0c38eb090876&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=de96e843cd68485785aad1355cbf0342 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:19.515975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3928fa-dfe7-46e9-bd67-43459ac92b9a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:19.546542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:19.561467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:19.562440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:19.562730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:19.563014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] PATH_INFO: `/v3/users/6a9c83476c564cc68f29eae847f266d9` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:19.564265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] RBAC: Authorizing `identity:get_user(user_id=6a9c83476c564cc68f29eae847f266d9)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:19.565772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:19.567503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 75/154] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:19 2022] GET /identity/v3/users/6a9c83476c564cc68f29eae847f266d9 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:19.575437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:19.745238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29e53-f6cf-4989-ba84-c21de9222f1a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:19.804888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68981-878f-4e99-bb30-84973c396516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:19.806351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68981-878f-4e99-bb30-84973c396516 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:19.806850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68981-878f-4e99-bb30-84973c396516 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:19.807369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68981-878f-4e99-bb30-84973c396516 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:19.809540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff68981-878f-4e99-bb30-84973c396516 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:19.812322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff68981-878f-4e99-bb30-84973c396516 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:19.823493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 80/155] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:19 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:19.830211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:19.991562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ddffa-f907-4c21-beb5-d879ec2428dd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:20.042502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:20.043770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:20.044249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:20.044738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b/users/6a9c83476c564cc68f29eae847f266d9/roles/bd5807e520da4cb190e242473e86f650` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:20.051788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e192fd2822654ca6913d270533f3a99b, user_id=6a9c83476c564cc68f29eae847f266d9, role_id=bd5807e520da4cb190e242473e86f650)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:20.053728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:20.061633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c7875-7fa9-4ede-80a4-1cb68aa95335 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:20.062309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c7875-7fa9-4ede-80a4-1cb68aa95335 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:20.062954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c7875-7fa9-4ede-80a4-1cb68aa95335 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:20.064594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 81/156] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:20.072242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7767d-2507-48a4-a252-e492e536b143 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:20.072898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7767d-2507-48a4-a252-e492e536b143 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:20.073414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7767d-2507-48a4-a252-e492e536b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:20.082975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 76/157] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:19 2022] PUT /identity/v3/projects/e192fd2822654ca6913d270533f3a99b/users/6a9c83476c564cc68f29eae847f266d9/roles/bd5807e520da4cb190e242473e86f650 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:59:20.101589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d8b7767d-2507-48a4-a252-e492e536b143 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:20.104391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d8b7767d-2507-48a4-a252-e492e536b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:20.128673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:20.224635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 82/158] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:20.267559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:20.341945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:20.401357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc979e-c9db-496b-b2fa-6719365810c4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:20.448899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:20.449724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:20.450007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:20.450308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:20.471423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:20.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:20.479675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:20.481083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:20.483186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 77/159] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:20.493587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7767d-2507-48a4-a252-e492e536b143 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:20.616995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7767d-2507-48a4-a252-e492e536b143 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:20.658663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:20.659368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:20.659658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:20.659941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:20.660815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:20.661168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:20.662610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:20.676989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 83/160] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:20.677964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:20.841249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1089f-09a1-4de1-9b88-55ed0efbe5c7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:20.863264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:20.892535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b662dc0-d467-41df-9716-10ce704c42c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:20.893352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662dc0-d467-41df-9716-10ce704c42c3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:20.893637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662dc0-d467-41df-9716-10ce704c42c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:20.893916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662dc0-d467-41df-9716-10ce704c42c3 None admin] PATH_INFO: `/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:20.895210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b662dc0-d467-41df-9716-10ce704c42c3 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:20.896689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b662dc0-d467-41df-9716-10ce704c42c3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:20.898411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 78/161] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:20 2022] GET /identity/v3/users/0eb3ee29f72e4aaaa17cfa0dfe2cba0d => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:20.904131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:20.924732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:21.116560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724ac3-d4a0-452a-9820-8290a91ed79f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:21.172432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:21.173016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:21.173303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:21.173678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:21.201263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760260-5549-4600-aed4-a5474565cc01 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:21.201569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760260-5549-4600-aed4-a5474565cc01 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:21.201829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760260-5549-4600-aed4-a5474565cc01 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:21.205092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 79/162] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:21.209656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583994-21a1-494e-bde5-b81eb6e79931 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:21.209946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583994-21a1-494e-bde5-b81eb6e79931 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:21.210251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583994-21a1-494e-bde5-b81eb6e79931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:21.257224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cf583994-21a1-494e-bde5-b81eb6e79931 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:21.258476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cf583994-21a1-494e-bde5-b81eb6e79931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:21.279488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:21.281057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:21.310533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:21.413306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 80/163] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:21.414694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f756272-865b-4fb5-ba18-de1dad5f351b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:21.414981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f756272-865b-4fb5-ba18-de1dad5f351b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:21.415253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f756272-865b-4fb5-ba18-de1dad5f351b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:21.416676 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 81/164] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:21.432983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5bac-a374-4a9d-8e2d-43bc2f07673b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:21.433264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5bac-a374-4a9d-8e2d-43bc2f07673b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:21.433442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5bac-a374-4a9d-8e2d-43bc2f07673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:21.460528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0e1b5bac-a374-4a9d-8e2d-43bc2f07673b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:21.461732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0e1b5bac-a374-4a9d-8e2d-43bc2f07673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:21.488373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 84/165] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:21.489271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:21.602281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 82/166] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 09:59:21.603169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b5bac-a374-4a9d-8e2d-43bc2f07673b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:21.678487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:21.717755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60acf6-ca1c-40b0-ad6a-788445a5905b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:21.742264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b5bac-a374-4a9d-8e2d-43bc2f07673b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:21.746538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:21.788225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:21.789845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:21.790636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:21.791598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:21.792047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:21.792461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:21.792869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:21.793277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:21.795165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:21.797607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:21.800958 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 83/167] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:21 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:21.802811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:21.820153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:21.828403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:21.829722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:21.830735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:21.843022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 85/168] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:21.844656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:21.971377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a65eee-a0a7-42f2-96c2-85f051d300bd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:21.981736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:22.052357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:22.053421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.053843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.054304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.076090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:22.085030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:22.086378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:22.087605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:22.099003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4a0d-f869-4e7d-826e-22115340dad6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:22.099848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 84/169] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:22.102415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:22.231004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:22.232700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.233495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.234376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.236265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:22.237084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:22.240104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:22.261515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 86/170] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:21 2022] GET /identity/v3/role_assignments?user.id=0eb3ee29f72e4aaaa17cfa0dfe2cba0d&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:22.262843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:22.269919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb8779-b12f-4457-9c36-4d64390c333e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:22.319090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:22.319812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.320100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.320380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.321174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:22.321488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:22.323061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:22.342020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 85/171] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:22.348575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:22.383557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:22.411151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:22.580692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f287fed-58d6-4541-8ec6-2b052768946a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:22.608728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea815cf-fff1-42db-bcb0-752d9a62b844 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:22.668015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:22.668930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.669215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.669488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.671007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:22.672653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:22.674843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 86/172] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:22 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:22.680768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:22.708925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bdeb-9c0f-498a-9d60-bd54f1fef53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:22.709638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bdeb-9c0f-498a-9d60-bd54f1fef53e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.710054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bdeb-9c0f-498a-9d60-bd54f1fef53e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.710376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bdeb-9c0f-498a-9d60-bd54f1fef53e None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.711197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bdeb-9c0f-498a-9d60-bd54f1fef53e None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:22.711512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bdeb-9c0f-498a-9d60-bd54f1fef53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:22.712985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bdeb-9c0f-498a-9d60-bd54f1fef53e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:22.723455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 87/173] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:22.725146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034b6c6-f206-4803-b138-4f418b687b41 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.725448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034b6c6-f206-4803-b138-4f418b687b41 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.725724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034b6c6-f206-4803-b138-4f418b687b41 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.731892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 88/174] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:22.733418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034b6c6-f206-4803-b138-4f418b687b41 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:22.828688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:22.838696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e26f7-84fe-4166-92ad-27df5a00a4f9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:22.885392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034b6c6-f206-4803-b138-4f418b687b41 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:22.894657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:22.903018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81048e-3b25-47c6-a062-b9799fb73730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:22.903715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81048e-3b25-47c6-a062-b9799fb73730 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.904086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81048e-3b25-47c6-a062-b9799fb73730 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.904342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81048e-3b25-47c6-a062-b9799fb73730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.939438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b12c9-bf08-4e47-bea8-a8cf19ea719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:22.940910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b12c9-bf08-4e47-bea8-a8cf19ea719f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.942490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b12c9-bf08-4e47-bea8-a8cf19ea719f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.943000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b12c9-bf08-4e47-bea8-a8cf19ea719f None admin] PATH_INFO: `/v3/users/de0861b677d84f47aa0c0c38eb090876` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.945477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b12c9-bf08-4e47-bea8-a8cf19ea719f None admin] RBAC: Authorizing `identity:get_user(user_id=de0861b677d84f47aa0c0c38eb090876)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:22.948485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b12c9-bf08-4e47-bea8-a8cf19ea719f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:22.951788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 89/175] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:22 2022] GET /identity/v3/users/de0861b677d84f47aa0c0c38eb090876 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:22.954089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83b3c6-a67c-48e9-99c3-45642503d480 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:22.954670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83b3c6-a67c-48e9-99c3-45642503d480 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:22.955158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83b3c6-a67c-48e9-99c3-45642503d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:22.987141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fb83b3c6-a67c-48e9-99c3-45642503d480 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:22.989372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fb83b3c6-a67c-48e9-99c3-45642503d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:23.073940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81048e-3b25-47c6-a062-b9799fb73730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:23.076901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81048e-3b25-47c6-a062-b9799fb73730 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:23.105232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 90/176] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:23.106543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83b3c6-a67c-48e9-99c3-45642503d480 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:23.238398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:23.249890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83b3c6-a67c-48e9-99c3-45642503d480 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:23.306102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:23.307621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bd576-7792-41dc-a884-1864c51efe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:23.308564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd576-7792-41dc-a884-1864c51efe33 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.309039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd576-7792-41dc-a884-1864c51efe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.309626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd576-7792-41dc-a884-1864c51efe33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.318556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 87/177] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:59:23.320475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43944c-1a1a-4977-9991-3f501245dd89 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.321004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43944c-1a1a-4977-9991-3f501245dd89 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.321498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43944c-1a1a-4977-9991-3f501245dd89 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.323263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 88/178] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:23.328762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43944c-1a1a-4977-9991-3f501245dd89 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:23.416979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bd576-7792-41dc-a884-1864c51efe33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:23.419251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bd576-7792-41dc-a884-1864c51efe33 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:23.472046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43944c-1a1a-4977-9991-3f501245dd89 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:23.516272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08c1f-3529-41ff-8321-ebfc5ebc6bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:23.517105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c1f-3529-41ff-8321-ebfc5ebc6bbd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.517384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c1f-3529-41ff-8321-ebfc5ebc6bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.517663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c1f-3529-41ff-8321-ebfc5ebc6bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.531909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e08c1f-3529-41ff-8321-ebfc5ebc6bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-37e08c1f-3529-41ff-8321-ebfc5ebc6bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:23.541813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:23.543093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:23.543887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 89/179] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:23.545014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7127-294a-40f6-a73e-d4c2827532c7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.545014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7127-294a-40f6-a73e-d4c2827532c7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.545014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7127-294a-40f6-a73e-d4c2827532c7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.546382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 90/180] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:23.548049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7127-294a-40f6-a73e-d4c2827532c7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:23.567394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:23.588631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 91/181] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:23.588631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c8e6-3163-4f60-9703-be9b7e8df14d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.588631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c8e6-3163-4f60-9703-be9b7e8df14d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.588631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c8e6-3163-4f60-9703-be9b7e8df14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.606922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f488c8e6-3163-4f60-9703-be9b7e8df14d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:23.608156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f488c8e6-3163-4f60-9703-be9b7e8df14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:23.654746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:23.706303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:23.706303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c8e6-3163-4f60-9703-be9b7e8df14d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:23.710939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7127-294a-40f6-a73e-d4c2827532c7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:23.757329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9fe4c-7598-4e53-aad0-8aafa097c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:23.758265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9fe4c-7598-4e53-aad0-8aafa097c30e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.758551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9fe4c-7598-4e53-aad0-8aafa097c30e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.758846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9fe4c-7598-4e53-aad0-8aafa097c30e None admin] PATH_INFO: `/v3/projects/240390d19bac4e41aad28580c21364cd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.760139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9fe4c-7598-4e53-aad0-8aafa097c30e None admin] RBAC: Authorizing `identity:get_project(project_id=240390d19bac4e41aad28580c21364cd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:23.761629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9fe4c-7598-4e53-aad0-8aafa097c30e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:23.763739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 91/183] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:23 2022] GET /identity/v3/projects/240390d19bac4e41aad28580c21364cd => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:23.770633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324f058-d7c0-4a91-a26b-a0c5e8dd185e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.770887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324f058-d7c0-4a91-a26b-a0c5e8dd185e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.771123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324f058-d7c0-4a91-a26b-a0c5e8dd185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.791260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1324f058-d7c0-4a91-a26b-a0c5e8dd185e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:23.792443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1324f058-d7c0-4a91-a26b-a0c5e8dd185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:23.837927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c8e6-3163-4f60-9703-be9b7e8df14d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:23.866067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:23.867784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 92/184] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:23.871315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324f058-d7c0-4a91-a26b-a0c5e8dd185e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:23.880996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:23.881680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:23.881963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:23.882261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:23.883027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:23.883336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:23.884737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:23.895052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 93/185] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:23.895956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:23.949354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:24.011697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324f058-d7c0-4a91-a26b-a0c5e8dd185e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.011971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffa8e1-c695-4258-98ea-67f672b0e6c0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.049936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f018c-7439-4d64-9d56-42845a605420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.050791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f018c-7439-4d64-9d56-42845a605420 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.051072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f018c-7439-4d64-9d56-42845a605420 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.051356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f018c-7439-4d64-9d56-42845a605420 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.060144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.061464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.061885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.062865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.064578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:24.067123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:24.067318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f018c-7439-4d64-9d56-42845a605420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:24.069124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 93/186] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:23 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:24.069905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-425f018c-7439-4d64-9d56-42845a605420 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:24.079588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:24.080661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 94/187] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:24.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8446382-e942-4696-9ab7-9795150d2422 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.088061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8446382-e942-4696-9ab7-9795150d2422 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.088061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8446382-e942-4696-9ab7-9795150d2422 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.088061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 95/188] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:24.088061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8446382-e942-4696-9ab7-9795150d2422 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.154572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:24.197308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316ca7-30f2-43cc-b212-3f726a62a4b1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.233329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:24.241087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8446382-e942-4696-9ab7-9795150d2422 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.246278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.247011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.247296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.247570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.248424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=240390d19bac4e41aad28580c21364cd, user.id=de0861b677d84f47aa0c0c38eb090876) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:24.248735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:24.250246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:24.257001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 94/189] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:24 2022] GET /identity/v3/role_assignments?user.id=de0861b677d84f47aa0c0c38eb090876&scope.project.id=240390d19bac4e41aad28580c21364cd&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:24.257911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.297429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.298614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.299023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.299428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.301240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:24.303275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:24.305301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 96/190] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:24.305956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.415830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6589392-6565-4759-86f9-2d178b8f3cf7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.437981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede19621-710c-4d9f-939b-2a79e3610343 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.455661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.456275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:24.456563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.456845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.457119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] PATH_INFO: `/v3/users/251697c0475841fea8db18e4de9a276f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.479060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] RBAC: Authorizing `identity:get_user(user_id=251697c0475841fea8db18e4de9a276f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:24.480574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:24.482468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 95/191] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:24 2022] GET /identity/v3/users/251697c0475841fea8db18e4de9a276f => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:24.483280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.497286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d006f-4efe-4f4e-a87c-564bff8029b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.498445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d006f-4efe-4f4e-a87c-564bff8029b5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.498931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d006f-4efe-4f4e-a87c-564bff8029b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.499418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d006f-4efe-4f4e-a87c-564bff8029b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.501017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d006f-4efe-4f4e-a87c-564bff8029b5 None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=de0861b677d84f47aa0c0c38eb090876) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:24.501579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d006f-4efe-4f4e-a87c-564bff8029b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:24.504448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d006f-4efe-4f4e-a87c-564bff8029b5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:24.513090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 97/192] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:24 2022] GET /identity/v3/role_assignments?user.id=de0861b677d84f47aa0c0c38eb090876&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:24.514416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002da35-1d4d-4b83-84f3-1bb75ed98174 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.514791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002da35-1d4d-4b83-84f3-1bb75ed98174 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.515149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002da35-1d4d-4b83-84f3-1bb75ed98174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.547586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7002da35-1d4d-4b83-84f3-1bb75ed98174 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:24.549667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7002da35-1d4d-4b83-84f3-1bb75ed98174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:24.561116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:24.649255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c091-89a0-4e68-9b22-e38e2de0d924 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.669912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 98/193] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:24.683203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002da35-1d4d-4b83-84f3-1bb75ed98174 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.715630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.716361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.716659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.716935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.718085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:24.719397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:24.721100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:24.732695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 96/194] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:24.733614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.816914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002da35-1d4d-4b83-84f3-1bb75ed98174 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.825106 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:24.866938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.868092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.868559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.869008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:24.870373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:24.873054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:24.876140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1621fb-8b95-4c0e-b21f-ec6c22e43de0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:24.885937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:24.900070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 99/195] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 09:59:24 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:24.900791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:24.935499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:24.936203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:24.936495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:24.936772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.041344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:25.043359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:25.057776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5622928-e849-416b-8c9a-fee1c52eb08e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:25.116027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:25.117113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:25.117113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:25.117364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.135942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:25.144975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:25.146127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:25.147133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:25.149326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 100/196] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:25.150461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:25.184713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:25.219396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 97/197] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:25.221157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:25.239829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:25.339539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366379e6-5796-4a5f-8343-1c8fbb898224 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:25.373692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb97aa-8eb9-4712-8074-28ad7d4a8f77 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:25.426338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:25.427054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:25.427342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:25.427628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.428435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:25.428723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:25.430156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:25.434539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:25.437635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:25.438760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:25.440384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] PATH_INFO: `/v3/users/251697c0475841fea8db18e4de9a276f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.442019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 98/198] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:25.443101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] RBAC: Authorizing `identity:get_user(user_id=251697c0475841fea8db18e4de9a276f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:25.443307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:25.447188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:25.452069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 101/199] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:25 2022] GET /identity/v3/users/251697c0475841fea8db18e4de9a276f => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:25.453754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:25.554444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:25.598292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4f0ce-66e6-4ef4-a3cf-8d31f5bf641e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:25.623278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:25.636375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725be37-b423-4535-8f30-61beb9e4e432 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:25.677227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:25.678641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:25.679100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:25.679371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:25.679691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] PATH_INFO: `/v3/users/6a9c83476c564cc68f29eae847f266d9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.680749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:25.681165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:25.681476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=6a9c83476c564cc68f29eae847f266d9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:25.681585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.683380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:25.683502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:25.685344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 102/200] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:25 2022] GET /identity/v3/users/6a9c83476c564cc68f29eae847f266d9 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:25.685837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:25.686748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:25.688797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 99/201] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:25 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:25.695689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:25.817776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67136732-c24b-49dd-b771-37a7130ba5a0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:25.850524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29b726-fb0c-4d12-a113-82320d4080f1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:25.877159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:25.878536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:25.879171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:25.879829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.893170 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:25.893760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:25.894045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:25.894358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:25.905900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:25.928613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:25.977478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:25.979220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:25.989226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:25.990879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:26.089432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 103/202] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:26.091023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:26.109992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 100/203] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:26.111043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:26.166294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:26.198572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:26.206489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03408-1a88-4828-9f90-acb34924c20f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:26.236742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a5f02-b94d-444a-8d97-7b9e2dae2d30 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:26.245443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:26.246136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:26.246474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:26.246771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:26.247610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=251697c0475841fea8db18e4de9a276f) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:26.247925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:26.249427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:26.262209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 104/204] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:26 2022] GET /identity/v3/role_assignments?user.id=251697c0475841fea8db18e4de9a276f&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:26.262209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:26.348980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:26.350161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:26.350517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:26.350805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:26.352547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:26.354132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:26.364383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 101/205] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:26 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:26.371082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:26.386923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fff36-6e7b-4a08-a395-43abdf446841 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:26.450507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:26.477995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:26.478926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:26.479210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:26.479487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:26.482562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:26.486335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:26.488664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 105/206] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:26 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:26.495460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:26.576991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072ba63-f3a0-4fd9-b14b-025dd25d6145 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:26.586542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:26.616424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dfa2e-8266-4fbb-a1d8-d7496647fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:26.617326 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dfa2e-8266-4fbb-a1d8-d7496647fd97 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:26.617490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dfa2e-8266-4fbb-a1d8-d7496647fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:26.617874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dfa2e-8266-4fbb-a1d8-d7496647fd97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:26.618964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dfa2e-8266-4fbb-a1d8-d7496647fd97 None admin] RBAC: Adding query filter params (role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=251697c0475841fea8db18e4de9a276f) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:26.619323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dfa2e-8266-4fbb-a1d8-d7496647fd97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:26.620846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dfa2e-8266-4fbb-a1d8-d7496647fd97 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:26.625408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05050161-859c-423e-85ed-6c4342831f37 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:26.628670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 102/207] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:26 2022] GET /identity/v3/role_assignments?user.id=251697c0475841fea8db18e4de9a276f&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=de96e843cd68485785aad1355cbf0342 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:26.665310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa96b4-f926-44af-a48c-12af37b38fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:26.666328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa96b4-f926-44af-a48c-12af37b38fdf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:26.666828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa96b4-f926-44af-a48c-12af37b38fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:26.667285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa96b4-f926-44af-a48c-12af37b38fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:26.668477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa96b4-f926-44af-a48c-12af37b38fdf None admin] RBAC: Adding query filter params (role.id=bd5807e520da4cb190e242473e86f650, scope.project.id=e192fd2822654ca6913d270533f3a99b, user.id=6a9c83476c564cc68f29eae847f266d9) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:26.668990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa96b4-f926-44af-a48c-12af37b38fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:26.670711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa96b4-f926-44af-a48c-12af37b38fdf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:26.678036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 106/208] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:26 2022] GET /identity/v3/role_assignments?user.id=6a9c83476c564cc68f29eae847f266d9&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=bd5807e520da4cb190e242473e86f650 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:27.530892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d33c3d-e7fa-4755-896a-ec4ffaf4eec1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:27.531434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d33c3d-e7fa-4755-896a-ec4ffaf4eec1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:27.531434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d33c3d-e7fa-4755-896a-ec4ffaf4eec1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:27.532911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 103/209] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:27.538440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb877f-031e-4315-be5c-47ef006ff8d6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:27.538896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb877f-031e-4315-be5c-47ef006ff8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:27.538982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb877f-031e-4315-be5c-47ef006ff8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:27.566153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-40bb877f-031e-4315-be5c-47ef006ff8d6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:27.568154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-40bb877f-031e-4315-be5c-47ef006ff8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:27.638384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe76e31-1a12-4c13-b1b0-3e3bd494026d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:27.638910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe76e31-1a12-4c13-b1b0-3e3bd494026d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:27.639392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe76e31-1a12-4c13-b1b0-3e3bd494026d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:27.639498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:27.643186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 104/210] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:27.652119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a270ad-4fcb-4059-892f-8c29556ce5d8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:27.652591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a270ad-4fcb-4059-892f-8c29556ce5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:27.653056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a270ad-4fcb-4059-892f-8c29556ce5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:27.667375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 107/211] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:27.679991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a8a270ad-4fcb-4059-892f-8c29556ce5d8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:27.681552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a8a270ad-4fcb-4059-892f-8c29556ce5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:27.705978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb877f-031e-4315-be5c-47ef006ff8d6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:27.766525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 105/212] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:27.790011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a270ad-4fcb-4059-892f-8c29556ce5d8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:27.836523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb877f-031e-4315-be5c-47ef006ff8d6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:27.875731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:27.876651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:27.876976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:27.877258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:27.879213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:27.881271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:27.883667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 108/213] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:27.890065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:27.904140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:27.907104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a270ad-4fcb-4059-892f-8c29556ce5d8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:27.946464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:27.947494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:27.947959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:27.948334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:27.961194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:27.969375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:27.981036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:27.982308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:27.983114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:27.985598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 106/214] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:27.993598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:28.046908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc575f-a749-4db2-9a4d-6d87012220aa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:28.087694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:28.088941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.089458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.090206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.091160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:28.093053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:28.102082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76663f-7004-4a32-bf0c-6d58faade0f6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:28.118239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 109/215] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 09:59:27 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:28.138842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:28.139548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.139833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.140650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.141448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:28.141757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:28.143267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:28.153177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 107/216] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:28.164486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:28.294354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11819c10-374f-47bb-8dd9-1b3c679a275b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:28.305299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:28.336913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afeacf-2eb1-447a-9a00-76c3653956ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:28.337835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afeacf-2eb1-447a-9a00-76c3653956ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.338126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afeacf-2eb1-447a-9a00-76c3653956ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.338450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afeacf-2eb1-447a-9a00-76c3653956ad None admin] PATH_INFO: `/v3/users/2490caea139941029c38673be12f3943` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.356497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afeacf-2eb1-447a-9a00-76c3653956ad None admin] RBAC: Authorizing `identity:get_user(user_id=2490caea139941029c38673be12f3943)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:28.358013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afeacf-2eb1-447a-9a00-76c3653956ad None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:28.360724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 110/217] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:28 2022] GET /identity/v3/users/2490caea139941029c38673be12f3943 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:28.366425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:28.396126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:28.504922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c84608-b981-4e11-a34e-f5d170f66bd9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:28.549234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:28.550734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.551214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.551698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.639445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:28.641322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:28.668783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:28.716256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18584-171b-4346-a6ef-8750d5bee7e0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.716763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18584-171b-4346-a6ef-8750d5bee7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.716870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18584-171b-4346-a6ef-8750d5bee7e0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.718743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 111/218] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:28.725629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5659b-0bb7-496c-baec-6b97fb2130d8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.725916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5659b-0bb7-496c-baec-6b97fb2130d8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.726210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5659b-0bb7-496c-baec-6b97fb2130d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.749694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-75e5659b-0bb7-496c-baec-6b97fb2130d8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:28.751527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-75e5659b-0bb7-496c-baec-6b97fb2130d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:28.775772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 108/219] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:28.782293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:28.874086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 112/220] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:28.877713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46120eb1-2f80-46ad-a96f-8f0e64f74dbc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.878213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46120eb1-2f80-46ad-a96f-8f0e64f74dbc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.878669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46120eb1-2f80-46ad-a96f-8f0e64f74dbc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.880199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 113/221] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:28.885436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d71ea-2d14-42f6-a07c-b0a4bc08a25f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:28.885944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d71ea-2d14-42f6-a07c-b0a4bc08a25f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:28.886532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d71ea-2d14-42f6-a07c-b0a4bc08a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:28.904739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-927d71ea-2d14-42f6-a07c-b0a4bc08a25f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:28.906647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-927d71ea-2d14-42f6-a07c-b0a4bc08a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:28.965561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06b827-c062-4069-9964-158f2b5bbe49 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:28.998445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 114/222] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:28.999141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:29.001511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d71ea-2d14-42f6-a07c-b0a4bc08a25f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.024304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.025725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.026815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.027176 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.028884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:29.030978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:29.033273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 109/223] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:28 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:29.038099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.051440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:29.132695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d71ea-2d14-42f6-a07c-b0a4bc08a25f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:29.157443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b5ab-0098-411f-a067-9895bbb1a3ad None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:29.169285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.170355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.170487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.170692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.182132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:29.190229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:29.191142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:29.191911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 115/224] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:29.192546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.199504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.200612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.201088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.201574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.212878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:29.222279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:29.223151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:29.223895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:29.226588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 110/225] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:29.227692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.282063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:29.302602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:29.310946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fbd0-f50b-4e51-aedb-0f622877f1ad None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:29.336446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698e507-b0b5-4442-9ee0-0149fb2e1a9e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:29.349377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.350035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.350363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.350649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.351506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=2490caea139941029c38673be12f3943) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:29.351827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:29.353510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:29.366202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 116/226] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/role_assignments?user.id=2490caea139941029c38673be12f3943&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:29.366202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.403004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.404991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.405301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.408414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.409222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:29.413467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:29.415963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:29.438818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 111/227] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:29.446856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.603979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca2574-14e7-4a59-805d-8648e7f5036d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:29.671942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccd5a-1920-4574-ad85-f60844a0cbb0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:29.676917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.677891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.678414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.678887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.679853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:29.683604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:29.685256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:29.702628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 117/228] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:29.702813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:29.709231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.735625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:29.759541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.760450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.760734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.761007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] PATH_INFO: `/v3/users/251697c0475841fea8db18e4de9a276f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.766996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] RBAC: Authorizing `identity:get_user(user_id=251697c0475841fea8db18e4de9a276f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:29.768761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:29.770799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 112/229] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/users/251697c0475841fea8db18e4de9a276f => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:29.778304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:29.851591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee456-e772-4295-9f6b-0af6c3d28eeb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:29.895326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:29.896734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:29.897221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:29.897696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] PATH_INFO: `/v3/users/251697c0475841fea8db18e4de9a276f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:29.899209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] RBAC: Authorizing `identity:get_user(user_id=251697c0475841fea8db18e4de9a276f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:29.900898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:29.903247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 118/230] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/users/251697c0475841fea8db18e4de9a276f => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:29.908982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:30.033854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c8e3-e063-47f9-a759-7b4115a78d4b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:30.077108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:30.102456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:30.103601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:30.103712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:30.103987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:30.105188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:30.106806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:30.109470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 113/231] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:30.114024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f95ad-1169-4d90-a7f2-282e01b89615 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:30.118627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:30.171966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:30.172847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:30.173130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:30.173489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:30.174748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:30.176215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:30.178250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 119/232] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:29 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:30.185146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:30.225610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:30.321953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870cab-fed4-4904-a164-363ce22b5216 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:30.352367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35cb66-3b30-471f-9049-76ad5b510d3d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:30.390694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d2ee-d6f9-46b3-a9cb-c387b4db3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:30.391611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2ee-d6f9-46b3-a9cb-c387b4db3890 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:30.391902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2ee-d6f9-46b3-a9cb-c387b4db3890 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:30.392237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2ee-d6f9-46b3-a9cb-c387b4db3890 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/251697c0475841fea8db18e4de9a276f/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:30.394319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d2ee-d6f9-46b3-a9cb-c387b4db3890 None admin] RBAC: Authorizing `identity:create_grant(project_id=80a3bed1dea441a3b770b9242bbb3dca, user_id=251697c0475841fea8db18e4de9a276f, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:30.394562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822ca7-6ade-4cba-9a25-338722172a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:30.395477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822ca7-6ade-4cba-9a25-338722172a88 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:30.395760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822ca7-6ade-4cba-9a25-338722172a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:30.395861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d2ee-d6f9-46b3-a9cb-c387b4db3890 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:30.396034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822ca7-6ade-4cba-9a25-338722172a88 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/251697c0475841fea8db18e4de9a276f/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:30.402838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad822ca7-6ade-4cba-9a25-338722172a88 None admin] RBAC: Authorizing `identity:create_grant(project_id=80a3bed1dea441a3b770b9242bbb3dca, user_id=251697c0475841fea8db18e4de9a276f, role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:30.404413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad822ca7-6ade-4cba-9a25-338722172a88 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:30.412357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 114/233] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:30 2022] PUT /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/251697c0475841fea8db18e4de9a276f/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:30.428651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 120/234] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:30 2022] PUT /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/251697c0475841fea8db18e4de9a276f/roles/de96e843cd68485785aad1355cbf0342 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:30.909050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938278d-0f7a-4ece-971c-690491c81022 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:30.909611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938278d-0f7a-4ece-971c-690491c81022 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:30.909611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938278d-0f7a-4ece-971c-690491c81022 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:30.911408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 115/235] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:30.918179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6ec8-4c08-4542-886e-daccb27f24c4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:30.918673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6ec8-4c08-4542-886e-daccb27f24c4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:30.919015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6ec8-4c08-4542-886e-daccb27f24c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:30.944064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2f2e6ec8-4c08-4542-886e-daccb27f24c4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:30.945342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2f2e6ec8-4c08-4542-886e-daccb27f24c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:30.947442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:31.054235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 121/236] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:31.073635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee5108-ec1b-49ec-b306-0e60f02ccc30 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.073937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee5108-ec1b-49ec-b306-0e60f02ccc30 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.074221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee5108-ec1b-49ec-b306-0e60f02ccc30 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.076052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 116/237] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:31.082067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd8948-26b5-4d7b-97a1-cc09c843929c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.082393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd8948-26b5-4d7b-97a1-cc09c843929c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.082672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd8948-26b5-4d7b-97a1-cc09c843929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.086099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee5108-ec1b-49ec-b306-0e60f02ccc30 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:31.105283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-15bd8948-26b5-4d7b-97a1-cc09c843929c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:31.106527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-15bd8948-26b5-4d7b-97a1-cc09c843929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:31.223538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 122/238] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:31.253488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd8948-26b5-4d7b-97a1-cc09c843929c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:31.345211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee5108-ec1b-49ec-b306-0e60f02ccc30 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:31.368369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:31.398741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:31.451821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:31.453216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.453721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.454236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.464554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:31.467611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:31.474949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 117/239] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:31.484780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:31.516991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd8948-26b5-4d7b-97a1-cc09c843929c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:31.610487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:31.611373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.611655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.612006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.634146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:31.645918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:31.647530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:31.648928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:31.652781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 123/240] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:31.661583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:31.714354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47206b18-b544-45c6-846e-08358fbf3fc6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:31.755448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf86e92-91d7-4fe3-b2a2-da785bb30acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:31.756328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf86e92-91d7-4fe3-b2a2-da785bb30acf None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.756613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf86e92-91d7-4fe3-b2a2-da785bb30acf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.756885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf86e92-91d7-4fe3-b2a2-da785bb30acf None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.757864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf86e92-91d7-4fe3-b2a2-da785bb30acf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:31.760127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf86e92-91d7-4fe3-b2a2-da785bb30acf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:31.786444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 118/241] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 09:59:31 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:59:31.788434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614fa09-aedc-476a-90d1-a55e15f8a55f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.788729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614fa09-aedc-476a-90d1-a55e15f8a55f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.789002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614fa09-aedc-476a-90d1-a55e15f8a55f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.794340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 119/242] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:31.797474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433e67-3c7d-4efd-b77c-b2c54db8262f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.797761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433e67-3c7d-4efd-b77c-b2c54db8262f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.798115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433e67-3c7d-4efd-b77c-b2c54db8262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.825811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10be58-6305-4049-87e7-78eb8a02d83c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:31.829777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-87433e67-3c7d-4efd-b77c-b2c54db8262f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:31.831435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-87433e67-3c7d-4efd-b77c-b2c54db8262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:31.865348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:31.890495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:31.916378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:31.917361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:31.917948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:31.918352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:31.919736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:31.920208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:31.927076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:31.927894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 120/243] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:31.953175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 124/244] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:31.954402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87433e67-3c7d-4efd-b77c-b2c54db8262f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:31.960190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:32.082256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87433e67-3c7d-4efd-b77c-b2c54db8262f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:32.135217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:32.139370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:32.140239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:32.140757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:32.157891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:32.169691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:32.170899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:32.172306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:32.175398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 121/245] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:32.182302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:32.205782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c49f-2c89-4f2b-83c2-7afb91a3e27f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:32.214789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:32.266067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:32.267193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:32.267487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:32.267760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] PATH_INFO: `/v3/users/14656ce460024a699d01d93b4640a1d0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:32.290078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] RBAC: Authorizing `identity:get_user(user_id=14656ce460024a699d01d93b4640a1d0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:32.291793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:32.293567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 125/246] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:31 2022] GET /identity/v3/users/14656ce460024a699d01d93b4640a1d0 => generated 297 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:32.299320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:32.353935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348420-3cb1-4425-a06e-94dfa38bc157 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:32.386131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:32.426260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:32.426960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:32.427252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:32.427635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:32.428411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:32.428719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:32.430114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:32.440729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 122/247] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:32.451483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:32.498040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c13b50-5bc6-4b21-bbb1-8b71a9a51a8b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:32.564784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:32.565813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:32.566337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:32.566823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:32.622970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:32.650774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e893f7-f405-4c4a-b125-7a3b216105aa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:32.675703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:32.677175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:32.747496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:32.754959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:32.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:32.756161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:32.756441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] PATH_INFO: `/v3/users/2490caea139941029c38673be12f3943` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:32.757776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] RBAC: Authorizing `identity:get_user(user_id=2490caea139941029c38673be12f3943)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:32.759267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:32.760938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 123/248] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:32 2022] GET /identity/v3/users/2490caea139941029c38673be12f3943 => generated 297 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:32.770160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:32.841099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 126/249] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:59:32.847253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:33.016234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a91a-fa52-4e60-9548-a4add400c3cd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:33.062644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b3e1d-50c4-43da-a652-422dee8eb8d9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:33.064919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:33.066077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.066563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.067001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.068385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:33.070036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:33.072433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 124/250] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:32 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:33.079109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:33.111133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:33.170965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:33.172080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.172430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.172781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.174156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:33.175803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:33.177912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 127/251] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:32 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:33.184117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:33.220889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:33.230677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aea5f5-f89c-4ed8-a422-aaad86ace1d2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:33.346905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcc1e7-4b92-4860-b7d8-c911f185720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:33.347826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcc1e7-4b92-4860-b7d8-c911f185720d None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.348107 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcc1e7-4b92-4860-b7d8-c911f185720d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.348382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcc1e7-4b92-4860-b7d8-c911f185720d None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/2490caea139941029c38673be12f3943/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.359425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcc1e7-4b92-4860-b7d8-c911f185720d None admin] RBAC: Authorizing `identity:create_grant(project_id=80a3bed1dea441a3b770b9242bbb3dca, user_id=2490caea139941029c38673be12f3943, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:33.361129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3b122-f695-49e0-a0f6-d4948ab88272 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:33.362083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcc1e7-4b92-4860-b7d8-c911f185720d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:33.387547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 125/252] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:33 2022] PUT /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/2490caea139941029c38673be12f3943/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:33.424568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04f9ae-03b3-4150-8d74-2348df483b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:33.425264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f9ae-03b3-4150-8d74-2348df483b41 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.425550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f9ae-03b3-4150-8d74-2348df483b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.425834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f9ae-03b3-4150-8d74-2348df483b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.426739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04f9ae-03b3-4150-8d74-2348df483b41 None admin] RBAC: Adding query filter params (role.id=bd5807e520da4cb190e242473e86f650, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=14656ce460024a699d01d93b4640a1d0) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:33.427060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04f9ae-03b3-4150-8d74-2348df483b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:33.428548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04f9ae-03b3-4150-8d74-2348df483b41 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:33.438372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 128/253] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:33 2022] GET /identity/v3/role_assignments?user.id=14656ce460024a699d01d93b4640a1d0&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=bd5807e520da4cb190e242473e86f650 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:33.631989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62e376-1b0b-4551-9992-0c1e88d09b20 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.632313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62e376-1b0b-4551-9992-0c1e88d09b20 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.632485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62e376-1b0b-4551-9992-0c1e88d09b20 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.634206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 126/254] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:33.634897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c82435-41ab-467d-bab7-d96c1a2ea0a8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.635194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c82435-41ab-467d-bab7-d96c1a2ea0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.635468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c82435-41ab-467d-bab7-d96c1a2ea0a8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.637058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 129/255] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:33.642903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313eedb-7e87-4da9-8d22-9070d8d06295 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.643201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313eedb-7e87-4da9-8d22-9070d8d06295 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.643466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313eedb-7e87-4da9-8d22-9070d8d06295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.646630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474d46f-9ceb-4dc1-8aba-04a4acf62089 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.646987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474d46f-9ceb-4dc1-8aba-04a4acf62089 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.647204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474d46f-9ceb-4dc1-8aba-04a4acf62089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.672047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4313eedb-7e87-4da9-8d22-9070d8d06295 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:33.673497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4313eedb-7e87-4da9-8d22-9070d8d06295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:33.683361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d474d46f-9ceb-4dc1-8aba-04a4acf62089 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:33.684602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d474d46f-9ceb-4dc1-8aba-04a4acf62089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:33.768740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 127/256] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:33.787996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 130/257] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:33.793298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313eedb-7e87-4da9-8d22-9070d8d06295 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:33.805387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:33.828629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474d46f-9ceb-4dc1-8aba-04a4acf62089 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:33.848438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:33.898780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313eedb-7e87-4da9-8d22-9070d8d06295 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:33.935573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:33.936398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:33.936680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:33.937494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:33.948430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:33.957354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:33.958271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:33.959056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 128/258] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:33.965214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:34.038538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:34.069091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513b1a-0086-4286-9aea-edd095824bf8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:34.096731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474d46f-9ceb-4dc1-8aba-04a4acf62089 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:34.104563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:34.105247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:34.105530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:34.105805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:34.106613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:34.106922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:34.108357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:34.117243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 129/259] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:34.128736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:34.161200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:34.161989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:34.162344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:34.162624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:34.186382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:34.195605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:34.196489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:34.197258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:34.201512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 131/260] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:34.203173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:34.333400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:34.390495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538b85-ed9a-475b-88a6-0a2da3bc2d22 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:34.430224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ab4e-c14e-4eba-9d0d-5b251a931ca8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:34.439882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:34.440953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:34.441438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:34.441915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:34.443019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:34.443533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:34.445137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:34.454952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 132/261] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:34.461052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:34.545333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:34.571561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:34.572692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:34.572802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:34.573007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] PATH_INFO: `/v3/users/251697c0475841fea8db18e4de9a276f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:34.574972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] RBAC: Authorizing `identity:get_user(user_id=251697c0475841fea8db18e4de9a276f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:34.576514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:34.578564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 130/262] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:34 2022] GET /identity/v3/users/251697c0475841fea8db18e4de9a276f => generated 283 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:34.579828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6c3c-5bc8-4a07-8329-0525b0a911ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:34.586784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:34.614350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:34.623415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:34.624887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:34.626674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:34.627359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] PATH_INFO: `/v3/users/251697c0475841fea8db18e4de9a276f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:34.629758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] RBAC: Authorizing `identity:get_user(user_id=251697c0475841fea8db18e4de9a276f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:34.634144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:34.636200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 133/263] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:34 2022] GET /identity/v3/users/251697c0475841fea8db18e4de9a276f => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:34.641858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:34.786611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e6a3b-770a-4297-8d3e-8dc6eb8859c4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:34.820903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1bf09-5dc5-45d1-87f3-a6970343eabd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:34.825465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:34.826491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:34.826979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:34.828062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:34.892663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:34.893434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:34.893727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:34.894009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:34.901664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:34.904659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:34.906860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:35.026264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 134/264] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:35.031486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:35.034889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:35.040051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:35.041629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:35.157171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:35.165177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a881a-2714-4d0e-83ec-2261af82c707 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:35.212685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:35.213602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:35.213890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:35.214218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:35.215832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:35.217373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:35.220023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 135/265] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:35 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:35.227222 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:35.295224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 131/266] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:59:35.303362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:35.371291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898ee6b-168d-4a8e-8992-23480e91c639 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:35.410583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:35.411258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:35.411544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:35.411828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:35.414202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=251697c0475841fea8db18e4de9a276f) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:35.414540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:35.416020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:35.429645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 136/267] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:35 2022] GET /identity/v3/role_assignments?user.id=251697c0475841fea8db18e4de9a276f&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:35.491226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:35.495033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4920f-91bd-43c1-a99e-1c4371e222b9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:35.563951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb590b-69a1-43b8-bf22-d0a73840e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:35.565377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb590b-69a1-43b8-bf22-d0a73840e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:35.566263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb590b-69a1-43b8-bf22-d0a73840e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:35.567038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb590b-69a1-43b8-bf22-d0a73840e8e8 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:35.575251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb590b-69a1-43b8-bf22-d0a73840e8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:35.577863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb590b-69a1-43b8-bf22-d0a73840e8e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:35.580394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 132/268] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:35 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:35.589292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:35.624007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:35.698900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a5eb9-5cc8-46dc-96af-1792b0c94656 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:35.735950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b17eb-915f-4819-bf3a-7421715c9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:35.736623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b17eb-915f-4819-bf3a-7421715c9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:35.736909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b17eb-915f-4819-bf3a-7421715c9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:35.737189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b17eb-915f-4819-bf3a-7421715c9cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:35.738042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b17eb-915f-4819-bf3a-7421715c9cf1 None admin] RBAC: Adding query filter params (role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=251697c0475841fea8db18e4de9a276f) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:35.738393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b17eb-915f-4819-bf3a-7421715c9cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:35.739862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b17eb-915f-4819-bf3a-7421715c9cf1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:35.746682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 137/269] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:35 2022] GET /identity/v3/role_assignments?user.id=251697c0475841fea8db18e4de9a276f&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=de96e843cd68485785aad1355cbf0342 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:35.923688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f3eb7-e7b7-48ba-9d86-e85b36d99ba5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:35.923917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f3eb7-e7b7-48ba-9d86-e85b36d99ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:35.924277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f3eb7-e7b7-48ba-9d86-e85b36d99ba5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:35.925538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 133/270] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:35.940589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650d02-e015-4dca-9e43-1eec5388d70b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:35.940905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650d02-e015-4dca-9e43-1eec5388d70b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:35.941164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650d02-e015-4dca-9e43-1eec5388d70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:35.960864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f5650d02-e015-4dca-9e43-1eec5388d70b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:35.962115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f5650d02-e015-4dca-9e43-1eec5388d70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:36.020832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d8892-d746-433e-a021-b3305530d8ca None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.021267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d8892-d746-433e-a021-b3305530d8ca None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.021714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d8892-d746-433e-a021-b3305530d8ca None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.031128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 134/271] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:36.039592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:36.041764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf9f94-7997-44c8-a821-1cb926aeb8aa None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf9f94-7997-44c8-a821-1cb926aeb8aa None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.042673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf9f94-7997-44c8-a821-1cb926aeb8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.062955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5650d02-e015-4dca-9e43-1eec5388d70b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:36.072404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dbdf9f94-7997-44c8-a821-1cb926aeb8aa None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:36.074229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dbdf9f94-7997-44c8-a821-1cb926aeb8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:36.091354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:36.170464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5650d02-e015-4dca-9e43-1eec5388d70b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:36.201924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 135/273] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:36.209441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:36.210325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.210614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.210890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.227445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:36.237168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf9f94-7997-44c8-a821-1cb926aeb8aa None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:36.238943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:36.239820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:36.241137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 139/274] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:36.246621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:36.345072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:36.358504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:36.362038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36706388-5071-449b-9d82-4480ee99cb4f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:36.363770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf9f94-7997-44c8-a821-1cb926aeb8aa None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:36.400187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:36.400805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.401092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.401374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.402141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:36.402482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:36.404114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:36.414299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 140/275] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:36.414810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:36.416128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.416626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.417095 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.418755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:36.419759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:36.420779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:36.426284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 136/276] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:36.429449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:36.553528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73bf0-4663-4729-943f-0d0fb1ee2e7b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:36.568317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ce249-8409-421c-8d00-bce9291129b1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:36.601325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128ff4-7356-4279-a502-d7f7eec00894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:36.602236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128ff4-7356-4279-a502-d7f7eec00894 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.602528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128ff4-7356-4279-a502-d7f7eec00894 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.602793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128ff4-7356-4279-a502-d7f7eec00894 None admin] PATH_INFO: `/v3/users/31572caf270f49acbad18b92bc93aca2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.614981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee247-c8f3-4b9b-8b37-2bab2f8dd341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:36.615900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee247-c8f3-4b9b-8b37-2bab2f8dd341 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.616351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee247-c8f3-4b9b-8b37-2bab2f8dd341 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.616766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee247-c8f3-4b9b-8b37-2bab2f8dd341 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.617942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee247-c8f3-4b9b-8b37-2bab2f8dd341 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:36.619930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128ff4-7356-4279-a502-d7f7eec00894 None admin] RBAC: Authorizing `identity:get_user(user_id=31572caf270f49acbad18b92bc93aca2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:36.620099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee247-c8f3-4b9b-8b37-2bab2f8dd341 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:36.621390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128ff4-7356-4279-a502-d7f7eec00894 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:36.623372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 141/277] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:36 2022] GET /identity/v3/users/31572caf270f49acbad18b92bc93aca2 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:36.630338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920b6e-0e19-4f15-8a49-d50812feb182 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.631437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920b6e-0e19-4f15-8a49-d50812feb182 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.631933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920b6e-0e19-4f15-8a49-d50812feb182 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.635446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 142/278] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:36.639242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920b6e-0e19-4f15-8a49-d50812feb182 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:36.650528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:36.666202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 137/279] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 09:59:36 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:59:36.666202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0a9a-b4a2-4dde-97ee-6f3e5f67e4e3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.666202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0a9a-b4a2-4dde-97ee-6f3e5f67e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.666202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0a9a-b4a2-4dde-97ee-6f3e5f67e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.688592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6cba0a9a-b4a2-4dde-97ee-6f3e5f67e4e3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:36.690480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6cba0a9a-b4a2-4dde-97ee-6f3e5f67e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:36.722324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:36.804304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 138/280] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:36.814448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920b6e-0e19-4f15-8a49-d50812feb182 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:36.828341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0a9a-b4a2-4dde-97ee-6f3e5f67e4e3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:36.853559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:36.854294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:36.854644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:36.854924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:36.855879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, user.id=31572caf270f49acbad18b92bc93aca2, scope.system=all) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:36.856194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:36.857777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:36.864434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jul 21 09:59:36 2022] GET /identity/v3/role_assignments?user.id=31572caf270f49acbad18b92bc93aca2&scope.system=all&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:36.958453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0a9a-b4a2-4dde-97ee-6f3e5f67e4e3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:37.002299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f7ccd-b266-4586-a611-0b0646e35655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:37.003140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7ccd-b266-4586-a611-0b0646e35655 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.003429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7ccd-b266-4586-a611-0b0646e35655 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.003707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7ccd-b266-4586-a611-0b0646e35655 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.017265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f7ccd-b266-4586-a611-0b0646e35655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5d4f7ccd-b266-4586-a611-0b0646e35655 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:37.025385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:37.026384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:37.027511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 139/282] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:37.033522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:37.128744 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:37.141289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27815-7ebe-4378-9a7f-a6f4185d9d98 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.141911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27815-7ebe-4378-9a7f-a6f4185d9d98 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.142004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27815-7ebe-4378-9a7f-a6f4185d9d98 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.143454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 140/283] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:37.148959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389d940-61ce-4586-80da-f3d0d04ea213 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.149252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389d940-61ce-4586-80da-f3d0d04ea213 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.149533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389d940-61ce-4586-80da-f3d0d04ea213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.170021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f389d940-61ce-4586-80da-f3d0d04ea213 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:37.171324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f389d940-61ce-4586-80da-f3d0d04ea213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:37.171839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf8908-6a84-4c49-a08d-a832b016aacd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:37.180684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:37.214336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:37.215272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.215542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.215819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.216585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:37.216891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:37.218960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:37.229018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 144/284] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:37.235179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:37.251048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 141/285] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:37.274334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389d940-61ce-4586-80da-f3d0d04ea213 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:37.512268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bb05b-9130-42d5-94c5-0834f4bcf9d8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:37.530915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389d940-61ce-4586-80da-f3d0d04ea213 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:37.554620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:37.563698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:37.564670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.564957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.565237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] PATH_INFO: `/v3/users/2490caea139941029c38673be12f3943` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.566655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] RBAC: Authorizing `identity:get_user(user_id=2490caea139941029c38673be12f3943)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:37.568154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:37.580984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 145/286] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:37 2022] GET /identity/v3/users/2490caea139941029c38673be12f3943 => generated 297 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:37.582725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:37.583562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.583850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.584123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.586535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:37.596854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:37.605226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:37.606194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:37.606968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 142/287] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:37.613075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:37.616180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:37.726687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbf91b-948e-4368-b5ca-8757ff168d28 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:37.772048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:37.772691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.772970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.773244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.774026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:37.774351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:37.775802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:37.785933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 143/288] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:37.791774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:37.802194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d69fe-5afd-43f6-890a-5532b84d6e69 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:37.863956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:37.905248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:37.907655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:37.908126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:37.908598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:37.937606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f322b0-1ea4-468a-83cc-c6abd3bd0c67 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:38.009818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:38.014768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:38.016427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:38.038364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:38.040192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:38.043052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:38.043335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] PATH_INFO: `/v3/users/14656ce460024a699d01d93b4640a1d0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:38.044827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=14656ce460024a699d01d93b4640a1d0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:38.047879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:38.056446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 144/289] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:37 2022] GET /identity/v3/users/14656ce460024a699d01d93b4640a1d0 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:38.058908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:38.223716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 146/290] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:59:38.229532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:38.269363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82bf04-2ed2-414a-89a0-9ab8c5d8b7f9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:38.306372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:38.307678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:38.308972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:38.309378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:38.314196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:38.314196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:38.314196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:38.315156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 145/291] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:38 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:38.321239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:38.470215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5ccc3-2499-4975-89e1-edb0ef7772fe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:38.506005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:38.513922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f4166-a09c-4b5e-821f-09dd8b94df4f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:38.587509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:38.589003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:38.590326 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:38.590838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/14656ce460024a699d01d93b4640a1d0/roles/bd5807e520da4cb190e242473e86f650` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:38.600145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] RBAC: Authorizing `identity:create_grant(project_id=80a3bed1dea441a3b770b9242bbb3dca, user_id=14656ce460024a699d01d93b4640a1d0, role_id=bd5807e520da4cb190e242473e86f650)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:38.605039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:38.649059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea278371-c77d-439f-940b-cbb0305449a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:38.650714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278371-c77d-439f-940b-cbb0305449a6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:38.651273 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278371-c77d-439f-940b-cbb0305449a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:38.651778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278371-c77d-439f-940b-cbb0305449a6 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:38.652813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 146/292] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 09:59:38 2022] PUT /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/users/14656ce460024a699d01d93b4640a1d0/roles/bd5807e520da4cb190e242473e86f650 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:38.654903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea278371-c77d-439f-940b-cbb0305449a6 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:38.658400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea278371-c77d-439f-940b-cbb0305449a6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:38.662502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 147/293] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:38 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:38.671548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:38.771342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:38.832062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbcaf8-74f1-4bae-a783-fe18f333955e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:38.893835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c79636-dc74-4013-bbd0-731504b5e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:38.895169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c79636-dc74-4013-bbd0-731504b5e85a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:38.895794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c79636-dc74-4013-bbd0-731504b5e85a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:38.896454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c79636-dc74-4013-bbd0-731504b5e85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:38.897950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c79636-dc74-4013-bbd0-731504b5e85a None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=2490caea139941029c38673be12f3943) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:38.898660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c79636-dc74-4013-bbd0-731504b5e85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:38.900983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c79636-dc74-4013-bbd0-731504b5e85a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:38.909443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 147/294] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:38 2022] GET /identity/v3/role_assignments?user.id=2490caea139941029c38673be12f3943&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:39.440057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddb1de-7fb0-48cd-a38a-4ab4f9b4a76b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:39.440617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddb1de-7fb0-48cd-a38a-4ab4f9b4a76b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:39.440617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddb1de-7fb0-48cd-a38a-4ab4f9b4a76b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:39.442263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 148/295] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:39.451237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276ca99-4460-4c43-9054-75e40cf6d823 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:39.451754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276ca99-4460-4c43-9054-75e40cf6d823 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:39.452716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276ca99-4460-4c43-9054-75e40cf6d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:39.506852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b276ca99-4460-4c43-9054-75e40cf6d823 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:39.509167 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b276ca99-4460-4c43-9054-75e40cf6d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:39.598549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 148/296] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:39.621783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddb1de-7fb0-48cd-a38a-4ab4f9b4a76b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:39.747352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa649-b3dd-43ea-bac9-450b07a4f909 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:39.748046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa649-b3dd-43ea-bac9-450b07a4f909 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:39.748537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa649-b3dd-43ea-bac9-450b07a4f909 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:39.750680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 149/297] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:39.756981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214be5-5625-43f0-a68a-870b24ded798 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:39.757415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214be5-5625-43f0-a68a-870b24ded798 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:39.757846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddb1de-7fb0-48cd-a38a-4ab4f9b4a76b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:39.758134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214be5-5625-43f0-a68a-870b24ded798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:39.777644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-64214be5-5625-43f0-a68a-870b24ded798 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:39.778964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-64214be5-5625-43f0-a68a-870b24ded798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:39.797785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9ca9a-f06f-412e-be02-32109c4e789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:39.798633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9ca9a-f06f-412e-be02-32109c4e789d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:39.798918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9ca9a-f06f-412e-be02-32109c4e789d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:39.799196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9ca9a-f06f-412e-be02-32109c4e789d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:39.810693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9ca9a-f06f-412e-be02-32109c4e789d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a0f9ca9a-f06f-412e-be02-32109c4e789d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:39.818590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:39.819551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:39.820366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 149/298] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:39.825985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d041-df16-4061-b71b-02cf398b3196 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:39.826322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d041-df16-4061-b71b-02cf398b3196 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:39.826580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d041-df16-4061-b71b-02cf398b3196 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:39.828421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 150/299] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:39.829519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d041-df16-4061-b71b-02cf398b3196 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:39.843642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:39.862486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:39.870427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 150/300] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:39.870427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0686a8-eb23-4af9-b049-34200220d676 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:39.870427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0686a8-eb23-4af9-b049-34200220d676 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:39.870427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0686a8-eb23-4af9-b049-34200220d676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:39.884509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ac0686a8-eb23-4af9-b049-34200220d676 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:39.885969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ac0686a8-eb23-4af9-b049-34200220d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:39.953499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d041-df16-4061-b71b-02cf398b3196 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:39.960440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 151/301] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:39.970802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0686a8-eb23-4af9-b049-34200220d676 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.014208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.015813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.016477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.016868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.018491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:40.019038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:40.020557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:40.031090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 151/302] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:40.031809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.105160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0686a8-eb23-4af9-b049-34200220d676 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:40.127650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:40.154657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.156054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.156338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.156610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.169953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:40.173243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:40.183157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:40.184390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:40.185250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:40.192742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 152/303] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:40.194441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.194679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0c89-682d-4dfc-8a08-47da350aa61d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:40.241464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.242309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.242598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.242877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.244543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:40.246019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:40.252759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 152/304] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:40.252759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.328878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cef15-4969-4fc8-be9f-47daa009734e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:40.369540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.370229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0145b-484c-44e8-826c-a4a7179eedfc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:40.370794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.371206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.371662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] PATH_INFO: `/v3/users/31572caf270f49acbad18b92bc93aca2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.373385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] RBAC: Authorizing `identity:get_user(user_id=31572caf270f49acbad18b92bc93aca2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:40.375695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:40.377449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 153/305] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:40 2022] GET /identity/v3/users/31572caf270f49acbad18b92bc93aca2 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:40.378272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.422283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.423303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.423809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.424272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.425206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:40.426267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:40.428272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:40.429338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:40.438492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 153/306] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:40.439336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.464426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:40.528620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aff51-f2f6-48ea-a08f-3ef8ce7b277f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:40.558104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821311b-0035-46cd-9840-ea96e97b3563 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:40.569881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.570610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.570902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.571207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] PATH_INFO: `/v3/groups` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.571888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:40.573362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:40.590301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 154/307] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Jul 21 09:59:40 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:59:40.597127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859d42-188a-4121-a705-878da68095ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.598085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859d42-188a-4121-a705-878da68095ed None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.598410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859d42-188a-4121-a705-878da68095ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.598745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859d42-188a-4121-a705-878da68095ed None admin] PATH_INFO: `/v3/system/users/31572caf270f49acbad18b92bc93aca2/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.599218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.600428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859d42-188a-4121-a705-878da68095ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=31572caf270f49acbad18b92bc93aca2, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:40.602000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859d42-188a-4121-a705-878da68095ed None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:40.613014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 154/308] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Jul 21 09:59:40 2022] PUT /identity/v3/system/users/31572caf270f49acbad18b92bc93aca2/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:40.750408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a231a-f962-4c7d-afe8-01e55c9108c2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:40.752589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:40.795436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5333ec-fcab-4ff5-853c-331aee767f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:40.797189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5333ec-fcab-4ff5-853c-331aee767f46 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:40.797969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5333ec-fcab-4ff5-853c-331aee767f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:40.798429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5333ec-fcab-4ff5-853c-331aee767f46 None admin] PATH_INFO: `/v3/users/2531571c0ce0490a8f62166e053614a5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:40.815182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5333ec-fcab-4ff5-853c-331aee767f46 None admin] RBAC: Authorizing `identity:get_user(user_id=2531571c0ce0490a8f62166e053614a5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:40.816922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5333ec-fcab-4ff5-853c-331aee767f46 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:40.818928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 155/309] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:40 2022] GET /identity/v3/users/2531571c0ce0490a8f62166e053614a5 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:40.828362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859d42-188a-4121-a705-878da68095ed None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:40.987379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:41.019797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859d42-188a-4121-a705-878da68095ed None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:41.076194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c87c37-10cb-44a8-88d8-0fce113f947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:41.077742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c87c37-10cb-44a8-88d8-0fce113f947e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:41.078270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c87c37-10cb-44a8-88d8-0fce113f947e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:41.078743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c87c37-10cb-44a8-88d8-0fce113f947e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:41.079827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c87c37-10cb-44a8-88d8-0fce113f947e None admin] RBAC: Adding query filter params (role.id=bd5807e520da4cb190e242473e86f650, user.id=2531571c0ce0490a8f62166e053614a5, scope.system=all) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:41.080352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c87c37-10cb-44a8-88d8-0fce113f947e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:41.082022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c87c37-10cb-44a8-88d8-0fce113f947e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:41.088859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 155/310] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jul 21 09:59:40 2022] GET /identity/v3/role_assignments?user.id=2531571c0ce0490a8f62166e053614a5&scope.system=all&role.id=bd5807e520da4cb190e242473e86f650 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:41.191554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d1b68-968b-4f41-bab6-8d36860e1f32 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:41.191840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d1b68-968b-4f41-bab6-8d36860e1f32 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:41.192103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d1b68-968b-4f41-bab6-8d36860e1f32 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:41.193909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 156/311] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:41.207603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63aa06-ec11-4cd7-b95e-127c71d7802c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:41.208056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63aa06-ec11-4cd7-b95e-127c71d7802c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:41.208548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63aa06-ec11-4cd7-b95e-127c71d7802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:41.239070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ff63aa06-ec11-4cd7-b95e-127c71d7802c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:41.241302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff63aa06-ec11-4cd7-b95e-127c71d7802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:41.345570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 156/312] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:41.370781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d1b68-968b-4f41-bab6-8d36860e1f32 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:41.529676 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d1b68-968b-4f41-bab6-8d36860e1f32 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:41.571471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:41.572307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:41.572632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:41.572892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:41.585174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:41.593559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:41.597254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:41.600746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 157/313] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:41.606249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63aa06-ec11-4cd7-b95e-127c71d7802c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:41.710500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:41.736666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63aa06-ec11-4cd7-b95e-127c71d7802c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:41.782482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:41.783445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:41.783887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:41.784327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:41.785316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:41.785798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:41.787577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:41.799062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 157/314] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:41.807964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:41.849910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:41.985412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9daa8-09f3-4eb7-bcd2-8de6a5dd01d2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:42.028246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:42.029447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:42.029898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:42.030390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] PATH_INFO: `/v3/users/14656ce460024a699d01d93b4640a1d0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:42.031876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] RBAC: Authorizing `identity:get_user(user_id=14656ce460024a699d01d93b4640a1d0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:42.033596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:42.035640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 158/315] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:41 2022] GET /identity/v3/users/14656ce460024a699d01d93b4640a1d0 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:42.041757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:42.163056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fae60-25d9-4c44-ba8d-c35abcc20f9f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:42.217917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed9f16-522c-453e-9118-819875830ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:42.219107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed9f16-522c-453e-9118-819875830ece None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:42.219593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed9f16-522c-453e-9118-819875830ece None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:42.220076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed9f16-522c-453e-9118-819875830ece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:42.248383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:42.313473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed9f16-522c-453e-9118-819875830ece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:42.315097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed9f16-522c-453e-9118-819875830ece None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:42.424229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 158/316] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:42.431756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:42.570806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:42.587090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6ae5-4079-4123-81ba-8bc2c96725fd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:42.627603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f43ed4-e96e-4ee2-a557-82719b4b0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:42.628659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f43ed4-e96e-4ee2-a557-82719b4b0d3d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:42.628847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f43ed4-e96e-4ee2-a557-82719b4b0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:42.629053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f43ed4-e96e-4ee2-a557-82719b4b0d3d None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:42.630685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f43ed4-e96e-4ee2-a557-82719b4b0d3d None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:42.632179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f43ed4-e96e-4ee2-a557-82719b4b0d3d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:42.634223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 159/317] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:42 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:42.641523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed9f16-522c-453e-9118-819875830ece None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:42.703914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:42.823910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed9f16-522c-453e-9118-819875830ece None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:42.866130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce5aec-4590-496e-8561-a4dc25da2881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:42.867258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5aec-4590-496e-8561-a4dc25da2881 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:42.867746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5aec-4590-496e-8561-a4dc25da2881 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:42.868244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5aec-4590-496e-8561-a4dc25da2881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:42.869855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce5aec-4590-496e-8561-a4dc25da2881 None admin] RBAC: Adding query filter params (role.id=bd5807e520da4cb190e242473e86f650, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca, user.id=14656ce460024a699d01d93b4640a1d0) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:42.870439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce5aec-4590-496e-8561-a4dc25da2881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:42.873110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce5aec-4590-496e-8561-a4dc25da2881 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:42.885693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 159/318] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 09:59:42 2022] GET /identity/v3/role_assignments?user.id=14656ce460024a699d01d93b4640a1d0&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=bd5807e520da4cb190e242473e86f650 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:43.112271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03375-1216-4004-bd29-74d296113720 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.112766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03375-1216-4004-bd29-74d296113720 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.113100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03375-1216-4004-bd29-74d296113720 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.116001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 160/319] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:43.125356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18778-fb9e-4ee6-8414-e13ed16e874d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.125663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18778-fb9e-4ee6-8414-e13ed16e874d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.125907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18778-fb9e-4ee6-8414-e13ed16e874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.142414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947e896-6eb7-4663-830e-3ebe6551884f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.142760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947e896-6eb7-4663-830e-3ebe6551884f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.142967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947e896-6eb7-4663-830e-3ebe6551884f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.144796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 161/320] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:43.150599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1136a-8133-4d52-84bb-ee8964b3fa95 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.150834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1136a-8133-4d52-84bb-ee8964b3fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.151116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1136a-8133-4d52-84bb-ee8964b3fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.153302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-09e18778-fb9e-4ee6-8414-e13ed16e874d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:43.154767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09e18778-fb9e-4ee6-8414-e13ed16e874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:43.169367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d3e1136a-8133-4d52-84bb-ee8964b3fa95 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:43.170597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d3e1136a-8133-4d52-84bb-ee8964b3fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:43.252853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 162/321] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:43.262556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 160/322] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:43.275386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1136a-8133-4d52-84bb-ee8964b3fa95 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:43.288664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18778-fb9e-4ee6-8414-e13ed16e874d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:43.324020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:43.370898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:43.390917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1136a-8133-4d52-84bb-ee8964b3fa95 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:43.401042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18778-fb9e-4ee6-8414-e13ed16e874d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:43.436992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:43.437936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.438406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.438647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.446249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:43.447059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.447343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.447618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.448815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:43.450320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:43.458551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 161/323] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 09:59:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:43.458795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:43.460729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:43.463401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:43.464247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:43.465270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 163/324] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:43.475643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:43.596573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40fde9-62df-4c14-a0b7-a57f6483f315 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:43.598142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:43.599065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582502e-1af9-4640-8196-f87edf2c2e6d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:43.634227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:43.634836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.635122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.635227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f146eca-5003-43a3-b34b-e9ed9aaf2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:43.635400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] PATH_INFO: `/v3/groups` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.636017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146eca-5003-43a3-b34b-e9ed9aaf2c5c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.636104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:43.636302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146eca-5003-43a3-b34b-e9ed9aaf2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.636576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146eca-5003-43a3-b34b-e9ed9aaf2c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.637334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146eca-5003-43a3-b34b-e9ed9aaf2c5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:43.637525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:43.637642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146eca-5003-43a3-b34b-e9ed9aaf2c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:43.639081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146eca-5003-43a3-b34b-e9ed9aaf2c5c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:43.651529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 164/325] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:43.652842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c551bb5-fc66-4dc5-b26f-35cf66b6e7e4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.653131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c551bb5-fc66-4dc5-b26f-35cf66b6e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.653407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c551bb5-fc66-4dc5-b26f-35cf66b6e7e4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.662307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 162/326] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Jul 21 09:59:43 2022] POST /identity/v3/groups => generated 226 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:59:43.663098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 165/327] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:43.663268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:43.663408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11aca3-d23d-4fd7-b1cc-716b9e4da671 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.663408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11aca3-d23d-4fd7-b1cc-716b9e4da671 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.663408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11aca3-d23d-4fd7-b1cc-716b9e4da671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.687242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dd11aca3-d23d-4fd7-b1cc-716b9e4da671 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:43.688668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dd11aca3-d23d-4fd7-b1cc-716b9e4da671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:43.691251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:43.777358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 166/328] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:43.794224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dec2e3-0c28-43f2-8747-65fa364addb6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:43.812046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11aca3-d23d-4fd7-b1cc-716b9e4da671 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:43.839570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:43.841139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:43.841473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:43.841812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] PATH_INFO: `/v3/users/31572caf270f49acbad18b92bc93aca2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:43.843240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] RBAC: Authorizing `identity:get_user(user_id=31572caf270f49acbad18b92bc93aca2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:43.844822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:43.846602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 163/329] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:43 2022] GET /identity/v3/users/31572caf270f49acbad18b92bc93aca2 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:43.852813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:43.895290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:43.966598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11aca3-d23d-4fd7-b1cc-716b9e4da671 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:44.013856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:44.015561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:44.015840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:44.016112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:44.021037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e89d-276c-4bef-8855-0ffe7daa0f0a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:44.024780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:44.030698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:44.040463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:44.041410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:44.042220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 167/330] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:44.048567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:44.072379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:44.073060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:44.073358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:44.073636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:44.074539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] RBAC: Adding query filter params (role.id=f0335c15ec8744d9bbe266c5df640a34, user.id=31572caf270f49acbad18b92bc93aca2, scope.system=all) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:44.074862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:44.076351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:44.091295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 164/331] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jul 21 09:59:43 2022] GET /identity/v3/role_assignments?user.id=31572caf270f49acbad18b92bc93aca2&scope.system=all&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:44.190959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7cee5-d19b-4d89-b10a-57806abef82d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:44.230820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:44.231898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:44.232440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:44.232914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:44.234569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:44.235103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:44.236998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:44.247955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 168/332] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:44.255802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:44.379571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:44.399598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419249a6-c15a-49da-972b-838529c8fbf9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:44.459018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4fbb5-5c3e-4a55-b0b3-4b19e1df92f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:44.460485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4fbb5-5c3e-4a55-b0b3-4b19e1df92f0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:44.460936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4fbb5-5c3e-4a55-b0b3-4b19e1df92f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:44.461377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4fbb5-5c3e-4a55-b0b3-4b19e1df92f0 None admin] PATH_INFO: `/v3/users/2531571c0ce0490a8f62166e053614a5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:44.463380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4fbb5-5c3e-4a55-b0b3-4b19e1df92f0 None admin] RBAC: Authorizing `identity:get_user(user_id=2531571c0ce0490a8f62166e053614a5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:44.466034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4fbb5-5c3e-4a55-b0b3-4b19e1df92f0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:44.468834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 165/333] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:44 2022] GET /identity/v3/users/2531571c0ce0490a8f62166e053614a5 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:44.477717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:44.554697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:44.600042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188161e9-6d8c-4621-b924-0e5209c123f7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:44.638923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69cfd6-4743-41bb-9378-fee80ef385cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:44.640710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69cfd6-4743-41bb-9378-fee80ef385cf None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:44.641215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69cfd6-4743-41bb-9378-fee80ef385cf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:44.641677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69cfd6-4743-41bb-9378-fee80ef385cf None admin] PATH_INFO: `/v3/system/users/2531571c0ce0490a8f62166e053614a5/roles/bd5807e520da4cb190e242473e86f650` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:44.643435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69cfd6-4743-41bb-9378-fee80ef385cf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2531571c0ce0490a8f62166e053614a5, role_id=bd5807e520da4cb190e242473e86f650)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:44.645020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69cfd6-4743-41bb-9378-fee80ef385cf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:44.656751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 169/334] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Jul 21 09:59:44 2022] PUT /identity/v3/system/users/2531571c0ce0490a8f62166e053614a5/roles/bd5807e520da4cb190e242473e86f650 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:46.363500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730d413-191c-4e3d-9417-e1f18eea093e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:46.364553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730d413-191c-4e3d-9417-e1f18eea093e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:46.365053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730d413-191c-4e3d-9417-e1f18eea093e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:46.366934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 166/335] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:46.372129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae831-f83b-4b07-8d92-b74da6b22911 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:46.372998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae831-f83b-4b07-8d92-b74da6b22911 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:46.373557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae831-f83b-4b07-8d92-b74da6b22911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:46.392860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-997ae831-f83b-4b07-8d92-b74da6b22911 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:46.394414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-997ae831-f83b-4b07-8d92-b74da6b22911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:46.475551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 170/336] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:46.515913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730d413-191c-4e3d-9417-e1f18eea093e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:46.590461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bed01-2180-4f29-b283-f3a2b5af3b85 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:46.590777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bed01-2180-4f29-b283-f3a2b5af3b85 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:46.591027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bed01-2180-4f29-b283-f3a2b5af3b85 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:46.592422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 171/337] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:46.607936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bf208-5228-4091-9296-b1a953bf98d4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:46.608801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bf208-5228-4091-9296-b1a953bf98d4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:46.609073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bf208-5228-4091-9296-b1a953bf98d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:46.636723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-217bf208-5228-4091-9296-b1a953bf98d4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:46.637867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-217bf208-5228-4091-9296-b1a953bf98d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:46.643875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730d413-191c-4e3d-9417-e1f18eea093e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:46.684516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:46.685325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:46.685617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:46.685900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:46.697873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:46.706505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:46.707407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:46.708170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 167/338] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:46.713955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:46.735722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:46.750052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:46.784016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 172/339] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:46.826864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f724b-a46a-492a-9a3f-2d0660dce4a0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:46.838740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bf208-5228-4091-9296-b1a953bf98d4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:46.863694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:46.864383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:46.864670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:46.864949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:46.865733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:46.866047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:46.867485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:46.877525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 168/340] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:46.883111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:46.979177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:47.007263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428d33-5de4-4bbd-9f75-eccd846a24a4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:47.015451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bf208-5228-4091-9296-b1a953bf98d4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:47.049800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:47.050719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.051020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.051425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.086210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:47.087695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.088169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.088692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.122215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:47.129235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:47.130751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:47.145842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:47.147591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:47.149134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:47.157250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 173/341] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:47.169238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:47.223381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:47.247813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 169/342] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:59:47.253966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:47.297732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:47.408597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37447d-20f2-4c86-b1b0-ae1da9942ef9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:47.410779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86512a97-d363-4a92-a345-bdbcebc7b302 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:47.473113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b86c-dbc9-4b22-a388-2d6d8934f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:47.474014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b86c-dbc9-4b22-a388-2d6d8934f644 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.474337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b86c-dbc9-4b22-a388-2d6d8934f644 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.474619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b86c-dbc9-4b22-a388-2d6d8934f644 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.475912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b86c-dbc9-4b22-a388-2d6d8934f644 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:47.477458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b86c-dbc9-4b22-a388-2d6d8934f644 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:47.479604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 170/343] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:47 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:47.480923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cc413-d837-44d7-9b55-745464493109 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.481212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cc413-d837-44d7-9b55-745464493109 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.481479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cc413-d837-44d7-9b55-745464493109 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.487331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 171/344] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:47.489349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cc413-d837-44d7-9b55-745464493109 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:47.493296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f0506-2f6d-4fef-a30b-ec765263624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:47.494071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f0506-2f6d-4fef-a30b-ec765263624d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.494400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f0506-2f6d-4fef-a30b-ec765263624d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.494682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f0506-2f6d-4fef-a30b-ec765263624d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.495470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f0506-2f6d-4fef-a30b-ec765263624d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:47.495780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f0506-2f6d-4fef-a30b-ec765263624d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:47.497202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f0506-2f6d-4fef-a30b-ec765263624d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:47.507440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 174/345] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:47.508779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6431ed-8338-4bf2-812a-a6c29eccfaea None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.509069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6431ed-8338-4bf2-812a-a6c29eccfaea None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.509350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6431ed-8338-4bf2-812a-a6c29eccfaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.535195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5d6431ed-8338-4bf2-812a-a6c29eccfaea None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:47.536345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5d6431ed-8338-4bf2-812a-a6c29eccfaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:47.587390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:47.682196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 175/346] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:47.682196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6431ed-8338-4bf2-812a-a6c29eccfaea None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:47.683277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cc413-d837-44d7-9b55-745464493109 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:47.755354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:47.756159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.756439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.756716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.757667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:47.776826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:47.778330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:47.780997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 172/347] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:47 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:47.781798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:47.885779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6431ed-8338-4bf2-812a-a6c29eccfaea None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:47.934696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:47.935523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:47.935840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:47.936743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:47.969340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe3e6-6d8c-4c07-9630-b55d60fc46ac None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:47.999271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:48.050567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:48.051947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:48.052446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:48.052939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:48.081477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:48.090437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:48.091372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 173/348] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:48.092718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:48.111088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:48.112594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:48.180899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:48.219891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b4a5-b4fc-4fd6-99fb-65d9aee47d77 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:48.265334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:48.266019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:48.266450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:48.266953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:48.268434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=e192fd2822654ca6913d270533f3a99b) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:48.268917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:48.271415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:48.281348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 174/349] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 09:59:48 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:48.286601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:48.350644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:48.383150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 176/350] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:48.392790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:48.471003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb34c-7756-47cf-9364-6222a40c342c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:48.529765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:48.531092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:48.531493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:48.531782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:48.532717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:48.533043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:48.534536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:48.544553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 175/351] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:48.555548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:48.642764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96ece-8d78-4284-a610-f5356f679645 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:48.705310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:48.706234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:48.706521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:48.706785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:48.709511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:48.711462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:48.713801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 177/352] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:48 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:48.728027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:48.735903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:48.788158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b60bdc-88ba-42e6-a259-5d9d0d271189 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:48.810613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:48.872012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68ffa-e300-4522-90e2-4f439e029912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:48.873155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68ffa-e300-4522-90e2-4f439e029912 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:48.873644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68ffa-e300-4522-90e2-4f439e029912 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:48.874082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68ffa-e300-4522-90e2-4f439e029912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:48.945560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc4d5-8fe4-4263-8652-102bf32d6cd1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:49.000417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b62381-e811-4a46-9ee3-2110f4a5a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:49.001625 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62381-e811-4a46-9ee3-2110f4a5a934 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.001923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62381-e811-4a46-9ee3-2110f4a5a934 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.002218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62381-e811-4a46-9ee3-2110f4a5a934 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.003544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b62381-e811-4a46-9ee3-2110f4a5a934 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:49.005000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b62381-e811-4a46-9ee3-2110f4a5a934 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:49.007012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 178/353] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:48 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:49.008265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36858f-d35b-49e6-8069-a3314da3806e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.008546 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36858f-d35b-49e6-8069-a3314da3806e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.008819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36858f-d35b-49e6-8069-a3314da3806e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.011733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 179/354] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:49.011733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c60b3-00ba-4fa7-9cd1-26ec0ef36e25 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.012004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c60b3-00ba-4fa7-9cd1-26ec0ef36e25 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.013916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c60b3-00ba-4fa7-9cd1-26ec0ef36e25 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.013916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 180/355] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:49.016219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68ffa-e300-4522-90e2-4f439e029912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:49.017089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c60b3-00ba-4fa7-9cd1-26ec0ef36e25 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:49.019302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68ffa-e300-4522-90e2-4f439e029912 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:49.133978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:49.181213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c60b3-00ba-4fa7-9cd1-26ec0ef36e25 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:49.185622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:49.200782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 176/356] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:59:49.205325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ec42-7aff-4366-8a17-3b1ff6d4ff9e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.206157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ec42-7aff-4366-8a17-3b1ff6d4ff9e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.208967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ec42-7aff-4366-8a17-3b1ff6d4ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.239919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2f22ec42-7aff-4366-8a17-3b1ff6d4ff9e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:49.241160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2f22ec42-7aff-4366-8a17-3b1ff6d4ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:49.250044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594841-ba13-4b3f-94ba-059ec2180155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:49.251748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594841-ba13-4b3f-94ba-059ec2180155 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.252471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594841-ba13-4b3f-94ba-059ec2180155 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.253152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594841-ba13-4b3f-94ba-059ec2180155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.255162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594841-ba13-4b3f-94ba-059ec2180155 None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=e192fd2822654ca6913d270533f3a99b) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:49.255983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594841-ba13-4b3f-94ba-059ec2180155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:49.259082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594841-ba13-4b3f-94ba-059ec2180155 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:49.268939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 181/357] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 09:59:49 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=de96e843cd68485785aad1355cbf0342 => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:49.271739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721c2c-f8d8-42a5-9f78-28cb6ad28d67 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.273097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721c2c-f8d8-42a5-9f78-28cb6ad28d67 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.273097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721c2c-f8d8-42a5-9f78-28cb6ad28d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.305772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d4721c2c-f8d8-42a5-9f78-28cb6ad28d67 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:49.308059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d4721c2c-f8d8-42a5-9f78-28cb6ad28d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:49.345831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 177/358] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:49.347426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ec42-7aff-4366-8a17-3b1ff6d4ff9e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:49.430353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 182/359] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:49.432770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffd601-f3b8-452b-ad49-6f7158e7b782 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.433203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffd601-f3b8-452b-ad49-6f7158e7b782 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.433663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffd601-f3b8-452b-ad49-6f7158e7b782 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.436216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 183/360] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:49.437397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffd601-f3b8-452b-ad49-6f7158e7b782 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:49.517006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ec42-7aff-4366-8a17-3b1ff6d4ff9e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:49.544541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:49.548884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:49.560085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672b896-64ab-4106-bff3-7ab4be05f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:49.561284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b896-64ab-4106-bff3-7ab4be05f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.561754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b896-64ab-4106-bff3-7ab4be05f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.562206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b896-64ab-4106-bff3-7ab4be05f1ae None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.563633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672b896-64ab-4106-bff3-7ab4be05f1ae None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:49.565248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672b896-64ab-4106-bff3-7ab4be05f1ae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:49.567540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 178/361] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:49 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:49.573319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c08d8-084b-48ae-a490-35739a19e241 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.574118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c08d8-084b-48ae-a490-35739a19e241 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.574603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c08d8-084b-48ae-a490-35739a19e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.583166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffd601-f3b8-452b-ad49-6f7158e7b782 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:49.593928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c02c08d8-084b-48ae-a490-35739a19e241 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:49.595495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c02c08d8-084b-48ae-a490-35739a19e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:49.621795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:49.622640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.622957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.623345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.637814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:49.650547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:49.652031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:59:49.652796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:49.655789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 184/362] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:49.656908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:49.672358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 179/363] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:49.672959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c08d8-084b-48ae-a490-35739a19e241 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:49.782684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320654-e8e1-4c3c-be77-8e635349338e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:49.782865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c08d8-084b-48ae-a490-35739a19e241 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:49.809190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:49.821112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:49.821985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.822407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.822801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.824433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:49.824547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:49.825452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:49.826122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:49.827763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.828290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.828392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 180/364] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:49 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:49.828962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.829129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:49.858132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:49.876027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:49.876975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:49.877770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:49.883384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 185/365] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:49.884818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:49.958723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5759f7-957a-4af8-87a6-cd23d939bc13 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:49.996445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:49.997130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:49.997416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:49.997693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:49.998530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:49.998981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:50.000510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:50.010213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aeaa1-8330-487a-9738-cddb8f9d0a79 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:50.010475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 181/366] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:50.011192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:50.051456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:50.052551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:50.052974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:50.053388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:50.066790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:50.074088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:50.077667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:50.078794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:50.079712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:50.082330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 186/367] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:50.083496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:50.136615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b264f0-18f0-46c2-aa6e-28d3d60b4ab6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:50.151929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:50.184636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:50.185408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:50.185580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:50.185859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:50.186877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:50.187206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:50.189227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:50.198982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 182/368] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 09:59:50 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:50.198982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:50.243897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a1d7-6c7b-4155-b966-d73d3c186d06 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:50.286136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:50.286893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:50.287861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:50.288147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:50.288927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:50.289234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:50.290698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:50.306398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 187/369] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:50.307486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:50.487900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba9b1c-0d1d-4726-b09e-fc7671a8770b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:50.507441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:50.546503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa08c34-4292-4adb-a70b-c017b4e5f4b1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:50.580752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:50.581767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:50.582277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:50.582748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:50.583743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:50.586370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:50.588060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:50.614061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 188/370] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:50.615457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:50.616235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:50.679683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:50.680561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:50.680847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:50.681757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] PATH_INFO: `/v3/users/2531571c0ce0490a8f62166e053614a5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:50.682496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] RBAC: Authorizing `identity:get_user(user_id=2531571c0ce0490a8f62166e053614a5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:50.683954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:50.685899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 183/371] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 09:59:50 2022] GET /identity/v3/users/2531571c0ce0490a8f62166e053614a5 => generated 293 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:50.687705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:50.896200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6de82-cfa7-4fa3-9c5f-2e17eae384fb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:50.910510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857381c-5a55-4e55-b73f-5cbba99f1da2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:50.964026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:50.966710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:50.967510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:50.969098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:50.995228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609cdb8-46e9-4878-8465-e3785c0a1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:50.996252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609cdb8-46e9-4878-8465-e3785c0a1057 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:50.996736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609cdb8-46e9-4878-8465-e3785c0a1057 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:50.997209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609cdb8-46e9-4878-8465-e3785c0a1057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:51.103849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:51.152487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:51.171198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:51.172697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:51.188553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609cdb8-46e9-4878-8465-e3785c0a1057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:51.190033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609cdb8-46e9-4878-8465-e3785c0a1057 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:51.393303 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 189/372] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:51.394204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:51.408594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 184/373] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:51.410726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae53d3-623b-489b-a02c-2780c7be09ce None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:51.411021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae53d3-623b-489b-a02c-2780c7be09ce None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:51.411300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae53d3-623b-489b-a02c-2780c7be09ce None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:51.412925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 185/374] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:51.413900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae53d3-623b-489b-a02c-2780c7be09ce None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:51.502929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:51.549065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:51.557353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fcf50-4701-4407-bca0-d590bdd86fd9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:51.569954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae53d3-623b-489b-a02c-2780c7be09ce None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:51.613041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:51.613925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:51.614231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:51.614513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:51.616163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:51.617624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:51.619402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 186/375] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:51 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:51.620257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:51.622924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7dec9-1623-4217-bf41-7f635ea7f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:51.624162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7dec9-1623-4217-bf41-7f635ea7f6fd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:51.624515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7dec9-1623-4217-bf41-7f635ea7f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:51.624794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7dec9-1623-4217-bf41-7f635ea7f6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:51.625655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7dec9-1623-4217-bf41-7f635ea7f6fd None admin] RBAC: Adding query filter params (role.id=bd5807e520da4cb190e242473e86f650, user.id=2531571c0ce0490a8f62166e053614a5, scope.system=all) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:51.625967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7dec9-1623-4217-bf41-7f635ea7f6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:51.629994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7dec9-1623-4217-bf41-7f635ea7f6fd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:51.645808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 190/376] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jul 21 09:59:51 2022] GET /identity/v3/role_assignments?user.id=2531571c0ce0490a8f62166e053614a5&scope.system=all&role.id=bd5807e520da4cb190e242473e86f650 => generated 510 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:51.647276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb538eb-1372-4e03-9e6c-4ddf5df9ced3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:51.647567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb538eb-1372-4e03-9e6c-4ddf5df9ced3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:51.647844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb538eb-1372-4e03-9e6c-4ddf5df9ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:51.669690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9cb538eb-1372-4e03-9e6c-4ddf5df9ced3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:51.671495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9cb538eb-1372-4e03-9e6c-4ddf5df9ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:51.752507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230370-30d2-4a85-adc4-6e2d278647c1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:51.788611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 191/377] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:51.789551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb538eb-1372-4e03-9e6c-4ddf5df9ced3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:51.799920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:51.800829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:51.801118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:51.801400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] PATH_INFO: `/v3/projects/639c2ba687ad420a81f045d494e495c1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:51.802893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] RBAC: Authorizing `identity:get_project(project_id=639c2ba687ad420a81f045d494e495c1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:51.804583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:51.810310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 187/378] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:51 2022] GET /identity/v3/projects/639c2ba687ad420a81f045d494e495c1 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:51.812833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:51.849347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:51.859867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:51.909808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb538eb-1372-4e03-9e6c-4ddf5df9ced3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:51.950099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:51.950927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:51.951210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:51.951486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:51.956431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:51.957929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:51.959921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 192/379] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:51 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:51.961658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:52.012387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96abc0e-1ebb-4b5c-a81f-3bdde1123b1d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:52.084689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a8c92-4791-47b2-80c7-03d5ed9634d9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:52.098951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:52.100449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.100943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.101412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] PATH_INFO: `/v3/groups/70b8493ff30b4dd981fae1978013cb34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.114919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] RBAC: Authorizing `identity:get_group(group_id=70b8493ff30b4dd981fae1978013cb34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:52.117008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:52.119614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 188/380] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:51 2022] GET /identity/v3/groups/70b8493ff30b4dd981fae1978013cb34 => generated 229 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:52.119987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:52.120972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:52.126124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:52.126982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.127266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.127543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.139780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:52.148028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:52.148938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:52.149711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 193/381] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:52.150476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:52.254447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b4b95-24f0-4881-9d04-a5a0cd605028 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:52.259090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:52.263775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c4e99-8e5a-4820-9424-1954d1a2aea2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:52.301599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:52.302413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.302699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.302977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.303823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] RBAC: Adding query filter params (group.id=70b8493ff30b4dd981fae1978013cb34, role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=639c2ba687ad420a81f045d494e495c1) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:52.304136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:52.305601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:52.313843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 194/382] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 09:59:52 2022] GET /identity/v3/role_assignments?group.id=70b8493ff30b4dd981fae1978013cb34&scope.project.id=639c2ba687ad420a81f045d494e495c1&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:52.314023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:52.315538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed807081-970b-4287-9880-045ebbb7077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:52.316431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed807081-970b-4287-9880-045ebbb7077c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.316894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed807081-970b-4287-9880-045ebbb7077c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.317383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed807081-970b-4287-9880-045ebbb7077c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.318493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed807081-970b-4287-9880-045ebbb7077c None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:52.319017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed807081-970b-4287-9880-045ebbb7077c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:52.320686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed807081-970b-4287-9880-045ebbb7077c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:52.330551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 189/383] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 09:59:52 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=de96e843cd68485785aad1355cbf0342 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:52.338540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8462b8-d4cc-43e3-85ca-6c4b572d312a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.338540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8462b8-d4cc-43e3-85ca-6c4b572d312a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.338540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8462b8-d4cc-43e3-85ca-6c4b572d312a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.338540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 190/384] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:52.345599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7064f8c-efde-4ca6-a141-e55eab734326 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.345969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7064f8c-efde-4ca6-a141-e55eab734326 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.346243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7064f8c-efde-4ca6-a141-e55eab734326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.384880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d7064f8c-efde-4ca6-a141-e55eab734326 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:52.386262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7064f8c-efde-4ca6-a141-e55eab734326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:52.426594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:52.572646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243bd4-d28b-4186-95e3-91c5ecb9d770 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:52.574221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 191/385] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:52.614563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7064f8c-efde-4ca6-a141-e55eab734326 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:52.627360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:52.628692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.629304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.630111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.638754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:52.639969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:52.641704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:52.658208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 195/386] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:52.663556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:52.798696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:52.849903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7064f8c-efde-4ca6-a141-e55eab734326 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:52.907776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62fd2a-3bcc-43f6-8997-0d81028986cc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:52.923839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:52.925585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.926361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.927072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.936100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:52.952115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:52.972502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:52.974144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:52.975601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:52.978949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:52.979842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:52.980122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:52.980395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:52.981429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 192/387] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:52.987158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:52.987593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:52.988647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:52.990663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 196/388] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:52 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:52.996192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:53.139558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b387-19d7-4ee8-b600-70ceceb2c090 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:53.197823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3001215-f1ae-4d69-940f-e5ebdedf5c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:53.198904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3001215-f1ae-4d69-940f-e5ebdedf5c7d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.199397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3001215-f1ae-4d69-940f-e5ebdedf5c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.199901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3001215-f1ae-4d69-940f-e5ebdedf5c7d None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.200483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95ced-c3b0-4032-a08b-2480e99e36b8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:53.201108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3001215-f1ae-4d69-940f-e5ebdedf5c7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:53.201700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3001215-f1ae-4d69-940f-e5ebdedf5c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:53.203706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3001215-f1ae-4d69-940f-e5ebdedf5c7d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:53.217025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 193/389] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:53.220409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4368b-0c2b-41c5-8270-d2e12ccefecb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.221295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4368b-0c2b-41c5-8270-d2e12ccefecb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.222236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4368b-0c2b-41c5-8270-d2e12ccefecb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.225352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 194/390] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:53.227214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4368b-0c2b-41c5-8270-d2e12ccefecb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:53.243088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:53.255280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96904e8-6816-4069-b9ec-717d7bd5206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:53.256523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96904e8-6816-4069-b9ec-717d7bd5206d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.256950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96904e8-6816-4069-b9ec-717d7bd5206d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.257362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96904e8-6816-4069-b9ec-717d7bd5206d None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.258834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96904e8-6816-4069-b9ec-717d7bd5206d None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:53.260422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96904e8-6816-4069-b9ec-717d7bd5206d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:53.262868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 197/391] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:52 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:53.264942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42a21-059b-48fa-96e7-d55828fc3b22 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.265373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42a21-059b-48fa-96e7-d55828fc3b22 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.265807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42a21-059b-48fa-96e7-d55828fc3b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.295138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b9e42a21-059b-48fa-96e7-d55828fc3b22 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:53.297128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b9e42a21-059b-48fa-96e7-d55828fc3b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:53.350406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:53.379759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 198/392] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:53.381487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e42a21-059b-48fa-96e7-d55828fc3b22 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:53.390747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4368b-0c2b-41c5-8270-d2e12ccefecb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:53.460708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:53.462119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.462607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.463067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.465281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:53.468386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:53.477391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 195/393] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:53 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:53.477391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:53.555228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e42a21-059b-48fa-96e7-d55828fc3b22 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:53.597657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:53.599027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.599612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.600111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.602348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] RBAC: Authorizing `identity:create_grant(project_id=e192fd2822654ca6913d270533f3a99b, group_id=fd47ac1bdf9947f08862e9cf16b63459, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:53.604247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:53.621331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:53.630151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 199/394] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jul 21 09:59:53 2022] PUT /identity/v3/projects/e192fd2822654ca6913d270533f3a99b/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:53.631502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:53.683017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edf079-3bb0-4504-bfd5-15f8dd58a1aa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:53.690718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:53.739381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:53.740262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.740579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.741390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.761659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:53.770756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:53.771719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:53.775000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 196/395] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:53.778018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:53.785306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040657d-fc5d-45eb-8ef3-b34b5957af00 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:53.838144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:53.839594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.840330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.840828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.842471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:53.844471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:53.846915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 200/396] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:53 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:53.853063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:53.921437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef42bd-106b-4f53-8716-4d417cd2af8c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:53.959084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:53.972008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:53.973450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:53.974496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:53.974999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:53.976206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:53.976687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:53.978587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:53.996350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 197/397] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:54.004973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:54.085388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37541-9d2f-489a-9746-f205bc3b85d2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:54.108883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:54.202055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:54.203634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:54.204123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:54.204604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:54.218788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e192fd2822654ca6913d270533f3a99b, group_id=fd47ac1bdf9947f08862e9cf16b63459, role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:54.221471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:54.261825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 201/398] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jul 21 09:59:53 2022] PUT /identity/v3/projects/e192fd2822654ca6913d270533f3a99b/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/de96e843cd68485785aad1355cbf0342 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:59:54.307681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007726e-f1f2-45da-b256-978a02561e25 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:54.375783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:54.377289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:54.377860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:54.378398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:54.380614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:54.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:54.386611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 198/399] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:54 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:54.395645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:54.612202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898c351-4897-47a7-9499-2e9ef0d347ee None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:54.678060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38cb89-76f6-48e3-bf59-f4a136bee0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:54.679642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cb89-76f6-48e3-bf59-f4a136bee0cd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:54.680131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cb89-76f6-48e3-bf59-f4a136bee0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:54.680595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cb89-76f6-48e3-bf59-f4a136bee0cd None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:54.683007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38cb89-76f6-48e3-bf59-f4a136bee0cd None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:54.684715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38cb89-76f6-48e3-bf59-f4a136bee0cd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:54.687634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 202/400] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:54 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:54.696390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:54.817527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:54.892935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613785aa-9c25-4ea8-8301-2611c00645f0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:54.928597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253efb9-d3e4-4009-9515-34d048ef1a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:54.929498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253efb9-d3e4-4009-9515-34d048ef1a07 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:54.929780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253efb9-d3e4-4009-9515-34d048ef1a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:54.930055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253efb9-d3e4-4009-9515-34d048ef1a07 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:54.932294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253efb9-d3e4-4009-9515-34d048ef1a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=80a3bed1dea441a3b770b9242bbb3dca, group_id=fd47ac1bdf9947f08862e9cf16b63459, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:54.933777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253efb9-d3e4-4009-9515-34d048ef1a07 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:54.953399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 199/401] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jul 21 09:59:54 2022] PUT /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:55.266347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3f24-1c73-4e2f-a1af-e6562f607d6e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:55.266859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3f24-1c73-4e2f-a1af-e6562f607d6e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:55.266966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3f24-1c73-4e2f-a1af-e6562f607d6e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:55.268666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 203/402] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:55.275193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f3b5-20a8-456f-8072-e4532a5d82c7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:55.275482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f3b5-20a8-456f-8072-e4532a5d82c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:55.275762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f3b5-20a8-456f-8072-e4532a5d82c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:55.296294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3346f3b5-20a8-456f-8072-e4532a5d82c7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:55.298506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3346f3b5-20a8-456f-8072-e4532a5d82c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:55.419173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 200/403] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:55.454919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3f24-1c73-4e2f-a1af-e6562f607d6e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:55.515188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:55.544691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bdc40-9b4c-441c-bd51-a7be2bba1624 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:55.545399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bdc40-9b4c-441c-bd51-a7be2bba1624 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:55.546643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bdc40-9b4c-441c-bd51-a7be2bba1624 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:55.550028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 201/404] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:55.560642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09454a4c-be6e-441d-93e3-526c8da526c0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:55.561534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09454a4c-be6e-441d-93e3-526c8da526c0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:55.562253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09454a4c-be6e-441d-93e3-526c8da526c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:55.600315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-09454a4c-be6e-441d-93e3-526c8da526c0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:55.604599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09454a4c-be6e-441d-93e3-526c8da526c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:55.651554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3f24-1c73-4e2f-a1af-e6562f607d6e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:55.721728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:55.743750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:55.745278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:55.745771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:55.747642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:55.770980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 202/405] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:59:55.772936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:55.789405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:55.791033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:55.792448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:55.796191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09454a4c-be6e-441d-93e3-526c8da526c0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:55.807708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 204/406] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:55.813995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:55.938997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09454a4c-be6e-441d-93e3-526c8da526c0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:55.987590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:55.988887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:55.989377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:55.989881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.003627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:56.015314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:56.023069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc85b07-fc42-45eb-9a52-5f1d3673eb13 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:56.028754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:56.029690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:59:56.030525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 09:59:56.034972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 203/407] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:56.041848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:56.108538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:56.109507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.109977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.110441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.111381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:56.111862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:56.113449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:56.133902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:56.136593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 205/408] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:56.149990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:56.253217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea98d98-ca30-40ab-8fa6-2dd17f70ca43 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:56.325132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:56.326243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.327294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.327768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.328734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:56.329236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:56.338201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:56.338470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9e38-38be-4806-a4c9-e5cdd57492f6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:56.363586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 204/409] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:56.370768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:56.388354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:56.390049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.390049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.390337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.394926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:56.396396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:56.402200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 206/410] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:56 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:56.418658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:56.453116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:56.538798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8e84e-a916-482e-8181-fc4fc1457d17 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:56.584398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:56.585297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.585579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.585856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.588067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:56.589558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:56.592275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 207/411] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:56 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:56.599683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:56.632724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be245f6-42fd-43a5-84ef-354034f26636 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:56.635774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:56.729060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:56.730052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.730383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.730653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] PATH_INFO: `/v3/groups/70b8493ff30b4dd981fae1978013cb34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.735089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] RBAC: Authorizing `identity:get_group(group_id=70b8493ff30b4dd981fae1978013cb34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:56.736646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:56.738865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 205/412] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:56 2022] GET /identity/v3/groups/70b8493ff30b4dd981fae1978013cb34 => generated 229 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:56.746327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:56.776593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:56.785126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d10b-2a8e-48c8-8fde-d2b68b892239 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:56.831297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96730a5-e8dc-44f3-b4fe-85c8ca3575dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:56.832203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96730a5-e8dc-44f3-b4fe-85c8ca3575dd None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.832480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96730a5-e8dc-44f3-b4fe-85c8ca3575dd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.832739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96730a5-e8dc-44f3-b4fe-85c8ca3575dd None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.835433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96730a5-e8dc-44f3-b4fe-85c8ca3575dd None admin] RBAC: Authorizing `identity:create_grant(project_id=80a3bed1dea441a3b770b9242bbb3dca, group_id=fd47ac1bdf9947f08862e9cf16b63459, role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:56.836978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96730a5-e8dc-44f3-b4fe-85c8ca3575dd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:56.853918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jul 21 09:59:56 2022] PUT /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca/groups/fd47ac1bdf9947f08862e9cf16b63459/roles/de96e843cd68485785aad1355cbf0342 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:56.855468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfafae-8495-4a53-8711-daa4825c3d39 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.855810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfafae-8495-4a53-8711-daa4825c3d39 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.856141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfafae-8495-4a53-8711-daa4825c3d39 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.857952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 209/414] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:56.875806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e49cd-1b9d-4797-945b-ad6ca48ff205 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.876177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e49cd-1b9d-4797-945b-ad6ca48ff205 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.876624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e49cd-1b9d-4797-945b-ad6ca48ff205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.907553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2040f-c577-40fa-bc84-18888fc538a4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:56.911865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-832e49cd-1b9d-4797-945b-ad6ca48ff205 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:56.913110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-832e49cd-1b9d-4797-945b-ad6ca48ff205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:56.947833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:56.948822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:56.949103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:56.949371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] PATH_INFO: `/v3/projects/639c2ba687ad420a81f045d494e495c1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:56.950743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] RBAC: Authorizing `identity:get_project(project_id=639c2ba687ad420a81f045d494e495c1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:56.953073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:56.955522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 206/415] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:56 2022] GET /identity/v3/projects/639c2ba687ad420a81f045d494e495c1 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:59:56.961966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:57.055153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:57.083471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 210/416] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:57.111685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e49cd-1b9d-4797-945b-ad6ca48ff205 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:57.165761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626310-fae0-47ef-8fb1-07926edfe17c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:57.210528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:57.211510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.211801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.212080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] PATH_INFO: `/v3/projects/639c2ba687ad420a81f045d494e495c1/groups/70b8493ff30b4dd981fae1978013cb34/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.214309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c2ba687ad420a81f045d494e495c1, group_id=70b8493ff30b4dd981fae1978013cb34, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:57.216070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:57.224599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:57.238552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 207/417] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jul 21 09:59:56 2022] PUT /identity/v3/projects/639c2ba687ad420a81f045d494e495c1/groups/70b8493ff30b4dd981fae1978013cb34/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:59:57.274995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e49cd-1b9d-4797-945b-ad6ca48ff205 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:57.335664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e8842-9240-4a98-970f-a82de5e86875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:57.336663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8842-9240-4a98-970f-a82de5e86875 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.336942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8842-9240-4a98-970f-a82de5e86875 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.337216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8842-9240-4a98-970f-a82de5e86875 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.358954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e8842-9240-4a98-970f-a82de5e86875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-464e8842-9240-4a98-970f-a82de5e86875 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:57.367076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:57.369240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:57.371329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 211/418] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:57.377736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:57.538382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:57.539759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5b25-60da-421e-983b-0d146898a45d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.540346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5b25-60da-421e-983b-0d146898a45d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.540346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5b25-60da-421e-983b-0d146898a45d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.542432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 212/419] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:57.544808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e04fd0-c661-40fb-9448-092b819d8f84 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:57.550223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a388-9a4b-4fb4-8256-f986e915128b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.550504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a388-9a4b-4fb4-8256-f986e915128b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.550815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a388-9a4b-4fb4-8256-f986e915128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.573448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5487a388-9a4b-4fb4-8256-f986e915128b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:57.575072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5487a388-9a4b-4fb4-8256-f986e915128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:57.612616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:57.614162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.614950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.615635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.617244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:57.618009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:57.620631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:57.636026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 208/420] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:57.644509 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:57.658836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 213/421] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:57.681925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a388-9a4b-4fb4-8256-f986e915128b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:57.760703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:57.797555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a388-9a4b-4fb4-8256-f986e915128b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:57.815726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bef0b4-3909-4932-86d2-25cbdae33a5f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:57.835492 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418eb0a-4165-49c5-abae-e974305f4f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:57.836305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418eb0a-4165-49c5-abae-e974305f4f0d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.836582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418eb0a-4165-49c5-abae-e974305f4f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.836853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418eb0a-4165-49c5-abae-e974305f4f0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.849724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418eb0a-4165-49c5-abae-e974305f4f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5418eb0a-4165-49c5-abae-e974305f4f0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:57.857990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:57.858956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:59:57.859721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:57.864113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 214/422] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 09:59:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:59:57.865592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e49dea-d065-4e42-8aae-393bdccfa852 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.865880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e49dea-d065-4e42-8aae-393bdccfa852 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.866191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e49dea-d065-4e42-8aae-393bdccfa852 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.871839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 215/423] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:59:57.871839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e49dea-d065-4e42-8aae-393bdccfa852 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:57.874709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:57.875571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:57.875845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:57.876133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:57.908148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:57.957913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:57.959456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:58.011224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e49dea-d065-4e42-8aae-393bdccfa852 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:58.067317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:58.078549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f5501-2ac4-41a1-974e-2391c71f3909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:58.079623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f5501-2ac4-41a1-974e-2391c71f3909 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.080062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f5501-2ac4-41a1-974e-2391c71f3909 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.080514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f5501-2ac4-41a1-974e-2391c71f3909 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.081498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f5501-2ac4-41a1-974e-2391c71f3909 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:58.082068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f5501-2ac4-41a1-974e-2391c71f3909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:58.083953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f5501-2ac4-41a1-974e-2391c71f3909 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:58.095169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 216/424] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 09:59:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:58.097799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dd1c6-3906-4e39-946c-d2a26dcfe29f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.098630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dd1c6-3906-4e39-946c-d2a26dcfe29f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.099269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dd1c6-3906-4e39-946c-d2a26dcfe29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.108821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 209/425] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:58.110609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:58.125137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e11dd1c6-3906-4e39-946c-d2a26dcfe29f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:58.128215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e11dd1c6-3906-4e39-946c-d2a26dcfe29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:58.200927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:58.246198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed84cf-19db-40fa-8acc-aba778dd1f70 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:58.283306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 217/426] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:58.285444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dd1c6-3906-4e39-946c-d2a26dcfe29f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:58.285614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:58.286857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.287393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.287924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.407887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:58.410276 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:58.426330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dd1c6-3906-4e39-946c-d2a26dcfe29f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:58.457158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:58.478121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:58.479378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.479882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.480357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.481864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:58.485496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:58.488210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:58.491090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 218/427] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:58.493172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:58.546070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 210/428] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:58.546070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:58.656548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15c7d6-f801-4a0f-a2bb-19ceff2560d8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:58.685276 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed97e9-9db9-4328-8088-160930995268 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:58.699331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:58.700142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.700429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.700706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.722007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:59:58.730841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:59:58.731781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:59:58.733471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 09:59:58.739107 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 219/429] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:59:58.741486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:58.749896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:58.750861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.751147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.751450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.753343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:58.755802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:58.760565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 211/430] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:58.761804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:58.816385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:58.827939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:58.881812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cea531-f11e-4923-8cfb-995102e21d6a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:58.909221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574bfc2-0b1e-4306-8df4-1e704d27242a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:58.930489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:58.931858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.932298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.932738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] PATH_INFO: `/v3/projects/e192fd2822654ca6913d270533f3a99b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.934785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] RBAC: Authorizing `identity:get_project(project_id=e192fd2822654ca6913d270533f3a99b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:58.938077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:58.940941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 220/431] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/projects/e192fd2822654ca6913d270533f3a99b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:58.942451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:58.950865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:58.952435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:58.953189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:58.953984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:58.955373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:58.956038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:58.957965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:58.968686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 212/432] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:58.969864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:59.077279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:59.089488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f256ad-5a55-464b-bc99-8db0fd1a5428 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:59.120494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b4e8-a985-4c33-a2f6-4023c7efe005 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:59.140867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:59.143012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:59.143839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:59.144717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:59.147482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:59.150494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:59.151430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:59.157711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 213/433] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:59.160295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:59.172085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:59.172759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:59.173043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:59.173323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:59.174202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=e192fd2822654ca6913d270533f3a99b) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:59.174546 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:59.176100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:59.190211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 221/434] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 09:59:58 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 611 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:59.190211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:59.340365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567257-6a2d-4f8f-a721-22f2f9a7d349 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:59.347020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae7b9-7b03-4c39-9cdf-2a667be0f27a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:59.388992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:59.389934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:59.390363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:59.390758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:59.391726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=e192fd2822654ca6913d270533f3a99b) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:59:59.392152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:59.394163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:59.401332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 222/435] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 09:59:59 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=e192fd2822654ca6913d270533f3a99b&role.id=de96e843cd68485785aad1355cbf0342 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:59.439164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525d0d0-2c0d-4b5c-be25-299878519ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:59.439863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525d0d0-2c0d-4b5c-be25-299878519ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:59.440157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525d0d0-2c0d-4b5c-be25-299878519ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:59.440439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525d0d0-2c0d-4b5c-be25-299878519ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:59.478142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:59.522474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525d0d0-2c0d-4b5c-be25-299878519ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:59.524170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525d0d0-2c0d-4b5c-be25-299878519ea2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:59.636191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 214/436] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 09:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:59:59.644514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:59.657123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe06f7b-7318-40c0-9c3c-0157cae30f35 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:59.657450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe06f7b-7318-40c0-9c3c-0157cae30f35 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:59.660242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe06f7b-7318-40c0-9c3c-0157cae30f35 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:59.660242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 215/437] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 09:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:59:59.666092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52780c65-8a44-4105-91dd-05d790cbb420 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:59.666677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52780c65-8a44-4105-91dd-05d790cbb420 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:59.667148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52780c65-8a44-4105-91dd-05d790cbb420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:59.691718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-52780c65-8a44-4105-91dd-05d790cbb420 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:59:59.692976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52780c65-8a44-4105-91dd-05d790cbb420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:59:59.733059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:59.768463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:59:59.786036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 216/438] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 09:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:59:59.803994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647de3d6-6bb2-4270-a5ca-c332d9b033b0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:59:59.810260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52780c65-8a44-4105-91dd-05d790cbb420 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:59.854996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:59:59.855922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:59:59.856709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:59:59.856988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:59:59.858619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:59:59.860376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:59:59.863987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 223/439] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 09:59:59 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:59:59.870505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:59:59.952969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52780c65-8a44-4105-91dd-05d790cbb420 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.001921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67c114-3224-45df-a024-ba7c5d04d3a7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.003641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a9d7d-9133-4f18-b46b-1b92d4c08f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.004463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a9d7d-9133-4f18-b46b-1b92d4c08f2e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.005993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a9d7d-9133-4f18-b46b-1b92d4c08f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.005993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a9d7d-9133-4f18-b46b-1b92d4c08f2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.017730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a9d7d-9133-4f18-b46b-1b92d4c08f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a97a9d7d-9133-4f18-b46b-1b92d4c08f2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:00.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:00.028727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:00.030303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 217/440] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 09:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:00.031378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eeb1-ad25-4ba1-a89d-00c7eedc9636 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.031378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eeb1-ad25-4ba1-a89d-00c7eedc9636 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.031580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eeb1-ad25-4ba1-a89d-00c7eedc9636 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.032783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 218/441] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:00.034663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00eeb1-ad25-4ba1-a89d-00c7eedc9636 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.039629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.067514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2628ac8-4b3b-496e-b28d-441b5666f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.068753 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628ac8-4b3b-496e-b28d-441b5666f6eb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.069161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628ac8-4b3b-496e-b28d-441b5666f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.069443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628ac8-4b3b-496e-b28d-441b5666f6eb None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.070678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2628ac8-4b3b-496e-b28d-441b5666f6eb None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:00.072131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2628ac8-4b3b-496e-b28d-441b5666f6eb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:00.073975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 224/442] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 09:59:59 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:00.076180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0578ee7-4b7d-4396-ab48-ba3f191787b9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.077032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0578ee7-4b7d-4396-ab48-ba3f191787b9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.077316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0578ee7-4b7d-4396-ab48-ba3f191787b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.097423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f0578ee7-4b7d-4396-ab48-ba3f191787b9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:00.099086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0578ee7-4b7d-4396-ab48-ba3f191787b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:00.105019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.167708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00eeb1-ad25-4ba1-a89d-00c7eedc9636 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.183213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 225/443] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:00.184080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0578ee7-4b7d-4396-ab48-ba3f191787b9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.204397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.205489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.205777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.206060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.206863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:00.207177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:00.208631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:00.218508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 219/444] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:00.219348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.289124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0578ee7-4b7d-4396-ab48-ba3f191787b9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.303169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.319129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95bc86-11b9-461d-8cb5-ab133627ce2e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.324558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.325161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.325444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.325719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.327126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=f0335c15ec8744d9bbe266c5df640a34, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:00.327438 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:00.328882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:00.330450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.335143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 226/445] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=f0335c15ec8744d9bbe266c5df640a34 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:00.335947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.359916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.360774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.361141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.361428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.374691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:00.383311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:00.384556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:00.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 220/446] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:00.394219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.462704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28e622-4e31-4519-9580-0581a4349e71 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.510295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.510959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.511238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.512207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.515541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6423-cb6a-4922-a0b2-79f6a186c1e0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.559815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.560513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.561347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.562550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.562550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:00.562792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:00.564219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:00.573453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.573718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 221/447] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:00.580383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.604782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:00.606299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:00.621063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.713541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80305278-980d-407a-83f9-e2c36f2bd1db None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.726648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 227/448] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:00.732370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.753031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.753734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.754028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.754357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.817561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.824258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:00.825736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:00.839292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174ba88-f1b4-454a-abad-048d3833c954 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:00.856896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:00.873917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:00.874819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:00.875102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:00.875383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] PATH_INFO: `/v3/projects/639c2ba687ad420a81f045d494e495c1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:00.876593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] RBAC: Authorizing `identity:get_project(project_id=639c2ba687ad420a81f045d494e495c1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:00.878060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:00.879822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 228/449] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/projects/639c2ba687ad420a81f045d494e495c1 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:00.885387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.926787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 222/450] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:00:00.932394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:00.994160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf88f7-191c-46d4-9be7-2f3e5440d4ab None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:01.034193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:01.035615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:01.036082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:01.036517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] PATH_INFO: `/v3/groups/70b8493ff30b4dd981fae1978013cb34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:01.038741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] RBAC: Authorizing `identity:get_group(group_id=70b8493ff30b4dd981fae1978013cb34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:01.041204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:01.044059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 229/451] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/groups/70b8493ff30b4dd981fae1978013cb34 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:01.045875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b5d5-16e3-4a36-82c8-aed611fdc5d9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:01.053547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:01.078384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:01.080749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:01.088092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:01.088963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:01.089277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:01.089520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] PATH_INFO: `/v3/projects/80a3bed1dea441a3b770b9242bbb3dca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:01.091070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] RBAC: Authorizing `identity:get_project(project_id=80a3bed1dea441a3b770b9242bbb3dca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:01.092526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:01.094477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 223/452] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:00:00 2022] GET /identity/v3/projects/80a3bed1dea441a3b770b9242bbb3dca => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:01.102252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:01.201738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae2045-ee07-44be-947c-5c089af739c6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:01.212446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c494ea-ff24-47c9-8415-c1db8c448732 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:01.249723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:01.250538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:01.250825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:01.251105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] PATH_INFO: `/v3/groups/fd47ac1bdf9947f08862e9cf16b63459` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:01.252306 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] RBAC: Authorizing `identity:get_group(group_id=fd47ac1bdf9947f08862e9cf16b63459)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:01.253756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:01.255444 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 224/453] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jul 21 10:00:01 2022] GET /identity/v3/groups/fd47ac1bdf9947f08862e9cf16b63459 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:01.257034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ec19f-0de7-4316-ae5f-0319953d6143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:01.258061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec19f-0de7-4316-ae5f-0319953d6143 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:01.258525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec19f-0de7-4316-ae5f-0319953d6143 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:01.258982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ec19f-0de7-4316-ae5f-0319953d6143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:01.260408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ec19f-0de7-4316-ae5f-0319953d6143 None admin] RBAC: Adding query filter params (group.id=70b8493ff30b4dd981fae1978013cb34, role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=639c2ba687ad420a81f045d494e495c1) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:01.260900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ec19f-0de7-4316-ae5f-0319953d6143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:01.261243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:01.263381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ec19f-0de7-4316-ae5f-0319953d6143 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:01.273416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 230/454] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 10:00:01 2022] GET /identity/v3/role_assignments?group.id=70b8493ff30b4dd981fae1978013cb34&scope.project.id=639c2ba687ad420a81f045d494e495c1&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:01.336429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:01.376228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9030-a526-4395-9269-866c5b0a3f19 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:01.428227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dbdad-fb73-407e-9c9f-43fb5e633101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:01.428898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbdad-fb73-407e-9c9f-43fb5e633101 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:01.429193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbdad-fb73-407e-9c9f-43fb5e633101 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:01.429474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbdad-fb73-407e-9c9f-43fb5e633101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:01.430365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbdad-fb73-407e-9c9f-43fb5e633101 None admin] RBAC: Adding query filter params (group.id=fd47ac1bdf9947f08862e9cf16b63459, role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=80a3bed1dea441a3b770b9242bbb3dca) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:01.430691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbdad-fb73-407e-9c9f-43fb5e633101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:01.432163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbdad-fb73-407e-9c9f-43fb5e633101 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:01.438844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 225/455] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jul 21 10:00:01 2022] GET /identity/v3/role_assignments?group.id=fd47ac1bdf9947f08862e9cf16b63459&scope.project.id=80a3bed1dea441a3b770b9242bbb3dca&role.id=de96e843cd68485785aad1355cbf0342 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:04.435592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7c7a-b370-4e73-aaa2-f12e1e843b00 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:04.436118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7c7a-b370-4e73-aaa2-f12e1e843b00 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:04.436192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7c7a-b370-4e73-aaa2-f12e1e843b00 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:04.437852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 231/456] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:04.443262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccd4c-f47a-4dcb-b00f-830866e0fd10 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:04.443700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccd4c-f47a-4dcb-b00f-830866e0fd10 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:04.443874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccd4c-f47a-4dcb-b00f-830866e0fd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:04.468335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e71ccd4c-f47a-4dcb-b00f-830866e0fd10 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:04.469567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e71ccd4c-f47a-4dcb-b00f-830866e0fd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:04.602026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 226/457] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:04.635437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7c7a-b370-4e73-aaa2-f12e1e843b00 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:04.760777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:04.799923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7c7a-b370-4e73-aaa2-f12e1e843b00 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:04.806017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4f1e-4f5e-41f2-bb1e-fc5f74fb3ae9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:04.806544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4f1e-4f5e-41f2-bb1e-fc5f74fb3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:04.807001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4f1e-4f5e-41f2-bb1e-fc5f74fb3ae9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:04.814353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 227/458] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:04.820320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdec3-1403-4787-9b7f-189c15cf83c1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:04.820629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdec3-1403-4787-9b7f-189c15cf83c1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:04.820885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdec3-1403-4787-9b7f-189c15cf83c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:04.847800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bf9cdec3-1403-4787-9b7f-189c15cf83c1 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:04.849249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf9cdec3-1403-4787-9b7f-189c15cf83c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:04.874713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:04.875922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:04.876399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:04.876966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:04.907563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:04.909043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:04.934826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:04.946476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 228/459] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:04.948099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545810d0-90e0-44be-9407-e7f7e68af2e5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:04.948451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545810d0-90e0-44be-9407-e7f7e68af2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:04.948798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545810d0-90e0-44be-9407-e7f7e68af2e5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:04.950437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 229/460] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:04.959596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:04.960462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:04.961284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:04.961284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:04.961284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:04.961284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:04.963067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 232/461] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:04.965750 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7e21-a852-4b02-b164-8d1b3a7b8d35 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:04.966267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7e21-a852-4b02-b164-8d1b3a7b8d35 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:04.966890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7e21-a852-4b02-b164-8d1b3a7b8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:04.969697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:04.995473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-36aa7e21-a852-4b02-b164-8d1b3a7b8d35 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:04.998443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-36aa7e21-a852-4b02-b164-8d1b3a7b8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:05.090309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 230/462] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:05.091183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7e21-a852-4b02-b164-8d1b3a7b8d35 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:05.104308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156221-4c8c-453e-844b-68bd2afad1f6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.146035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:05.154723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e86c4-62b2-4736-a264-53fa57d16ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.155680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e86c4-62b2-4736-a264-53fa57d16ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.156108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e86c4-62b2-4736-a264-53fa57d16ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.156526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e86c4-62b2-4736-a264-53fa57d16ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.158034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e86c4-62b2-4736-a264-53fa57d16ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:05.158518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e86c4-62b2-4736-a264-53fa57d16ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.160125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e86c4-62b2-4736-a264-53fa57d16ef6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.186859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 233/463] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:05.189509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863323b5-535b-46d9-bf99-745e1cd4ca43 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.190244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863323b5-535b-46d9-bf99-745e1cd4ca43 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.190943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863323b5-535b-46d9-bf99-745e1cd4ca43 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.193578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 234/464] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:05.197726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863323b5-535b-46d9-bf99-745e1cd4ca43 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:05.226271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7e21-a852-4b02-b164-8d1b3a7b8d35 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.251176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:05.266862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.267886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.268187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.268425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.280449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.282017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:05.300793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:05.301697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:05.303031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:05.303031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:05.303031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:05.303031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:05.303031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 231/465] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:05.303031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:05.356877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863323b5-535b-46d9-bf99-745e1cd4ca43 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.398928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770e467-6b3b-4af8-9c5a-1d3219344af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.399928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770e467-6b3b-4af8-9c5a-1d3219344af4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.400338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770e467-6b3b-4af8-9c5a-1d3219344af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.400719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770e467-6b3b-4af8-9c5a-1d3219344af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.414830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770e467-6b3b-4af8-9c5a-1d3219344af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.416136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770e467-6b3b-4af8-9c5a-1d3219344af4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2770e467-6b3b-4af8-9c5a-1d3219344af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:05.437516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:05.439841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 235/466] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147521-acfe-4532-b6cb-51483faca332 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147521-acfe-4532-b6cb-51483faca332 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147521-acfe-4532-b6cb-51483faca332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.452389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf1213-0e27-41b9-be78-f9d19a439844 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.461027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c3147521-acfe-4532-b6cb-51483faca332 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:05.462269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c3147521-acfe-4532-b6cb-51483faca332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:05.506734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:05.514156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.515345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.515859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.516586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.517621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.520227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.546325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 236/467] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:05.546944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 232/468] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:00:05 2022] POST /identity/v3/users => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:05.547766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:05.556559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147521-acfe-4532-b6cb-51483faca332 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:05.602835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:05.702087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe55c4-9fae-447f-a6da-444846abc3be None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.716623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147521-acfe-4532-b6cb-51483faca332 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.749679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.750788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.751079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.751337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.752097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:05.752453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.753949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.764802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00d39c-d299-4946-b9bc-c6807593fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.765575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00d39c-d299-4946-b9bc-c6807593fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.765975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00d39c-d299-4946-b9bc-c6807593fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.766477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00d39c-d299-4946-b9bc-c6807593fbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.767793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00d39c-d299-4946-b9bc-c6807593fbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:05.768314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00d39c-d299-4946-b9bc-c6807593fbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.770924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00d39c-d299-4946-b9bc-c6807593fbf1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.780268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 233/469] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:05.780268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:05.799408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 237/470] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:05.800783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390421-a5f5-4bb4-8053-6a433222aa68 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.801077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390421-a5f5-4bb4-8053-6a433222aa68 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.801364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390421-a5f5-4bb4-8053-6a433222aa68 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.802774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 238/471] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:05.805997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390421-a5f5-4bb4-8053-6a433222aa68 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:05.846287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:05.905894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:05.921908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5033b-b5c4-4d27-898e-d574fd75b367 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.937655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390421-a5f5-4bb4-8053-6a433222aa68 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:05.961725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.962625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.963007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.963381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.974985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.976577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.980291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb0ba-4a7b-40ee-8a7e-cac237232d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:05.981023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb0ba-4a7b-40ee-8a7e-cac237232d48 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:05.981306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb0ba-4a7b-40ee-8a7e-cac237232d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:05.981682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb0ba-4a7b-40ee-8a7e-cac237232d48 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:05.982482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb0ba-4a7b-40ee-8a7e-cac237232d48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:05.984899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb0ba-4a7b-40ee-8a7e-cac237232d48 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:05.996394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:05.997478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:05.998648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:05.998648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:05.998648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:05.998648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:06.000265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 234/472] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:06.001239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:06.021119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 239/473] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:00:05 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:06.030342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845bfc-f891-4283-817b-fa65ff8ccbff None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:06.030342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845bfc-f891-4283-817b-fa65ff8ccbff None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:06.030342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845bfc-f891-4283-817b-fa65ff8ccbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:06.049361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-94845bfc-f891-4283-817b-fa65ff8ccbff None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:06.050796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-94845bfc-f891-4283-817b-fa65ff8ccbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:06.132294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 240/474] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:06.133390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845bfc-f891-4283-817b-fa65ff8ccbff None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:06.163908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:06.198138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b6074-b087-40c0-b4fd-a67fcfd182ed None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:06.258354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:06.258354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:06.258732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:06.258911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:06.259598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:06.261599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:06.285029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:06.295640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845bfc-f891-4283-817b-fa65ff8ccbff None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:06.298144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 235/475] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:00:06 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:06.299863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:06.346575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:06.347420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:06.347769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:06.348108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:06.349349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:06.349952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:06.352653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:06.370705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 241/476] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:06.378648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:06.442267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0c115-3582-472c-9f39-59a0824a13f8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:06.487592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:06.488310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:06.488568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:06.488848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:06.489627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:06.492150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:06.494128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:06.511434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.sql.core [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 10:00:06.511434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 10:00:06.511434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [parameters: {'id': 'fb347e167927407591b3f71cc4768302', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 10:00:06.511434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80423) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 10:00:06.522817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1da99-1547-4ed2-a945-97820168165c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result.read() Jul 21 10:00:06.527803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:00:06.529345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application yield resource Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise self.value Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application session.commit() Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 10:00:06.531078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.session.flush() Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application compat.raise_( Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 10:00:06.532606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:00:06.535663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result.read() Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:00:06.537685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [parameters: {'id': 'fb347e167927407591b3f71cc4768302', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:06.541069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 10:00:06.543125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:06.545369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 236/477] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jul 21 10:00:06 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:06.545369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:06.601352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:06.602419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:06.602867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:06.603279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:06.604350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:06.606227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:06.628174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:06.645454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 242/478] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:00:06 2022] POST /identity/v3/users => generated 249 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:00:06.721539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a6a1f-6c6f-4599-b297-40f0ebd6f2be None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:06.777094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e48aad-c23d-4ef1-b538-9dcb17305023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:06.778267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48aad-c23d-4ef1-b538-9dcb17305023 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:06.778750 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48aad-c23d-4ef1-b538-9dcb17305023 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:06.779272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48aad-c23d-4ef1-b538-9dcb17305023 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:06.796256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e48aad-c23d-4ef1-b538-9dcb17305023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-75e48aad-c23d-4ef1-b538-9dcb17305023 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:06.808880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:06.809831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:00:06.811182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:06.813694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 237/479] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:06.820271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:06.971345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0869f-7a45-45b7-ba56-1b1457793e34 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:07.034465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f20e5-edba-405c-adef-53aad14af8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:07.035463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f20e5-edba-405c-adef-53aad14af8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:07.035971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f20e5-edba-405c-adef-53aad14af8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:07.036398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f20e5-edba-405c-adef-53aad14af8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:07.037774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f20e5-edba-405c-adef-53aad14af8c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:07.038318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f20e5-edba-405c-adef-53aad14af8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:07.040889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f20e5-edba-405c-adef-53aad14af8c9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:07.043432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:07.058922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 243/480] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:08.193562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274b353-ee46-47f4-85de-4a089214ece4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:08.194119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274b353-ee46-47f4-85de-4a089214ece4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:08.194415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274b353-ee46-47f4-85de-4a089214ece4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:08.196062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 238/481] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:08.207834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce94a-2c3b-4a73-bb46-82f99f544715 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:08.208365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce94a-2c3b-4a73-bb46-82f99f544715 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:08.208365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce94a-2c3b-4a73-bb46-82f99f544715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:08.230351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-11bce94a-2c3b-4a73-bb46-82f99f544715 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:08.231557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-11bce94a-2c3b-4a73-bb46-82f99f544715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:08.316591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 244/482] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:08.347539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274b353-ee46-47f4-85de-4a089214ece4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:08.493548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274b353-ee46-47f4-85de-4a089214ece4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:08.537407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:08.562363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:08.563513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:08.563914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:08.564207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:08.576900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:08.585144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:08.586048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:08.586935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 239/483] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:08.595463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce94a-2c3b-4a73-bb46-82f99f544715 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:08.752096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce94a-2c3b-4a73-bb46-82f99f544715 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:08.794415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:08.809678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19febc-dd04-4e33-b357-519f38d5f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:08.811046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19febc-dd04-4e33-b357-519f38d5f966 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:08.811336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19febc-dd04-4e33-b357-519f38d5f966 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:08.811618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19febc-dd04-4e33-b357-519f38d5f966 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:08.812414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19febc-dd04-4e33-b357-519f38d5f966 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:08.812723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19febc-dd04-4e33-b357-519f38d5f966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:08.814363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19febc-dd04-4e33-b357-519f38d5f966 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:08.826191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 245/484] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:08.832626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:08.957748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ff65-1654-4f2c-a6c4-8f7bf3301b1d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:08.958131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ff65-1654-4f2c-a6c4-8f7bf3301b1d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:08.958325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ff65-1654-4f2c-a6c4-8f7bf3301b1d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:08.959719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 246/485] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:08.972220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35c9a9-f988-4b24-8b2c-11e41d3aa05c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:08.972567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35c9a9-f988-4b24-8b2c-11e41d3aa05c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:08.972777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35c9a9-f988-4b24-8b2c-11e41d3aa05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:08.992376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ce35c9a9-f988-4b24-8b2c-11e41d3aa05c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:08.993580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ce35c9a9-f988-4b24-8b2c-11e41d3aa05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:08.998642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d18bb-f1d6-4cb6-a949-b0acf528edf6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:09.056852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:09.057661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.057946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.058255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.070577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:09.072194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:09.097565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:09.098572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:09.099415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:09.099415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:09.099415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:09.099415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:09.103592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 240/486] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:09.109400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:09.133584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 247/487] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:09.169608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:09.194287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35c9a9-f988-4b24-8b2c-11e41d3aa05c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:09.283963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8674a7-4f92-41c0-9160-3cd2015850ed None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:09.349986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35c9a9-f988-4b24-8b2c-11e41d3aa05c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:09.362356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734404f-146a-48b1-80b7-57898d1d119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:09.362645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734404f-146a-48b1-80b7-57898d1d119c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.362871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734404f-146a-48b1-80b7-57898d1d119c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.363139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734404f-146a-48b1-80b7-57898d1d119c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.363882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734404f-146a-48b1-80b7-57898d1d119c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:09.364187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734404f-146a-48b1-80b7-57898d1d119c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:09.365569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734404f-146a-48b1-80b7-57898d1d119c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:09.382050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 241/488] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:09.383421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:09.383608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc2ef-f704-4be1-b13b-d66c8edcb293 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.383873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc2ef-f704-4be1-b13b-d66c8edcb293 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.384156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc2ef-f704-4be1-b13b-d66c8edcb293 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.391090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 242/489] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:09.391090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acc2ef-f704-4be1-b13b-d66c8edcb293 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:09.413846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73439b65-0705-48e5-ac98-5ee210f68ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:09.415336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73439b65-0705-48e5-ac98-5ee210f68ccb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.416090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73439b65-0705-48e5-ac98-5ee210f68ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.416988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73439b65-0705-48e5-ac98-5ee210f68ccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.431961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73439b65-0705-48e5-ac98-5ee210f68ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-73439b65-0705-48e5-ac98-5ee210f68ccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:09.442451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:09.443421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:09.444276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 248/490] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:09.450847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4d00-bc8a-41e6-ae3f-d0239c3831fc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.450847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4d00-bc8a-41e6-ae3f-d0239c3831fc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.450847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4d00-bc8a-41e6-ae3f-d0239c3831fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.465302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-695b4d00-bc8a-41e6-ae3f-d0239c3831fc None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:09.466680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-695b4d00-bc8a-41e6-ae3f-d0239c3831fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:09.528995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:09.539432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acc2ef-f704-4be1-b13b-d66c8edcb293 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:09.558312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 249/491] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:09.559403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4d00-bc8a-41e6-ae3f-d0239c3831fc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:09.585218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d5bae-13c7-4bbf-ab39-9be7e74e6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:09.586451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d5bae-13c7-4bbf-ab39-9be7e74e6c86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.586943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d5bae-13c7-4bbf-ab39-9be7e74e6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.587443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d5bae-13c7-4bbf-ab39-9be7e74e6c86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.596443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d5bae-13c7-4bbf-ab39-9be7e74e6c86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:09.597934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d5bae-13c7-4bbf-ab39-9be7e74e6c86 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e73d5bae-13c7-4bbf-ab39-9be7e74e6c86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:09.616331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:09.618069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:09.619494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:09.622199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 243/492] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:00:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:09.623692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919466e4-b1d6-448f-8cfe-55e8bd7321fe None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.623984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919466e4-b1d6-448f-8cfe-55e8bd7321fe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.624264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919466e4-b1d6-448f-8cfe-55e8bd7321fe None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.630898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 244/493] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:09.630898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919466e4-b1d6-448f-8cfe-55e8bd7321fe None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:09.706794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4d00-bc8a-41e6-ae3f-d0239c3831fc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:09.722442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:09.752339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919466e4-b1d6-448f-8cfe-55e8bd7321fe None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:09.764925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:09.765619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.765890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.766187 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.766957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:09.767266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:09.768669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:09.778542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 250/494] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:09.779949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:09.802610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2a2f-0f6f-48d3-8cb7-7fb17c7ff98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:09.803908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2a2f-0f6f-48d3-8cb7-7fb17c7ff98a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.804378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2a2f-0f6f-48d3-8cb7-7fb17c7ff98a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.804830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2a2f-0f6f-48d3-8cb7-7fb17c7ff98a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.822247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a2a2f-0f6f-48d3-8cb7-7fb17c7ff98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-956a2a2f-0f6f-48d3-8cb7-7fb17c7ff98a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:09.831819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:09.832919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:09.834125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 245/495] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:09.835289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e154-4f72-4837-ae97-066f100a062b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.835289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e154-4f72-4837-ae97-066f100a062b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.835289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e154-4f72-4837-ae97-066f100a062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.853893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ec58e154-4f72-4837-ae97-066f100a062b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:09.855134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ec58e154-4f72-4837-ae97-066f100a062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:09.870582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:09.946523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 246/496] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:09.947245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4fc84-6103-47ed-b411-78ce2935e0fa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:09.947380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e154-4f72-4837-ae97-066f100a062b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:09.987732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:09.988410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:09.988696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:09.988976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:09.989838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:09.990149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:09.991636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.032106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 251/497] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:00:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:10.032962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.065022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.072317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e154-4f72-4837-ae97-066f100a062b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.107016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea0355-27c2-4371-84c3-636b6cca846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.107824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0355-27c2-4371-84c3-636b6cca846b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.108108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0355-27c2-4371-84c3-636b6cca846b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.108390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0355-27c2-4371-84c3-636b6cca846b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.118521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea0355-27c2-4371-84c3-636b6cca846b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.120006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea0355-27c2-4371-84c3-636b6cca846b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.122726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-beea0355-27c2-4371-84c3-636b6cca846b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:10.138923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:10.140034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:10.141255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:10.141255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:10.141255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:10.141255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:10.141255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 247/498] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:10.141560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5dfc8-6222-4da8-a235-74b408e331db None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.141847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5dfc8-6222-4da8-a235-74b408e331db None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.142123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5dfc8-6222-4da8-a235-74b408e331db None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.146373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 248/499] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:10.146373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5dfc8-6222-4da8-a235-74b408e331db None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.167318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d87da-e6c2-4748-b630-21ec33e97014 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.205247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.205924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.206235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.206517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.207274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:10.207584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.209011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.222976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 252/500] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:10.223640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.268811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5dfc8-6222-4da8-a235-74b408e331db None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.310022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.310900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.311187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.311467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.321968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:10.330795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:10.331839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 249/501] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:10.337804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.351584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.367845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6e858-19db-46fd-afa9-86e8dd5b8626 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.397346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.408474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.409136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.409419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.409697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.444906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9edd-a20b-4a70-adaf-7b2141d92f7b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.482059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d92b0-32d9-4bd5-b253-d03bf441b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.482785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d92b0-32d9-4bd5-b253-d03bf441b481 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.483073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d92b0-32d9-4bd5-b253-d03bf441b481 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.483359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d92b0-32d9-4bd5-b253-d03bf441b481 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.483484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.484096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d92b0-32d9-4bd5-b253-d03bf441b481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:10.484406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d92b0-32d9-4bd5-b253-d03bf441b481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.484949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.485774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d92b0-32d9-4bd5-b253-d03bf441b481 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.500170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 250/502] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:10.501695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4737a9-873c-40f3-ade7-2692f35a3eff None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.501945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4737a9-873c-40f3-ade7-2692f35a3eff None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.502180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4737a9-873c-40f3-ade7-2692f35a3eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.518870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4b4737a9-873c-40f3-ade7-2692f35a3eff None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:10.520111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4b4737a9-873c-40f3-ade7-2692f35a3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:10.579811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.590404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 253/503] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:10.590404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.595092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 251/504] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:10.595443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4737a9-873c-40f3-ade7-2692f35a3eff None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.645157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.710035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0895499-adc6-4448-8db9-78d21a28c16f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.714684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4737a9-873c-40f3-ade7-2692f35a3eff None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.748549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.749751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.750195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.750594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.753959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.754698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.754983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.755264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.756020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:10.756328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.758159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.761154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.762656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.766733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 252/505] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:10.767553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:10.781696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:10.782807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:10.788678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:10.788678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:10.788678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:10.788678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:10.788678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 254/506] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:10.788678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.833162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.877058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf23f8-1dab-4b0f-9522-0ff08b869bc5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.886654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:10.896135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74613d36-c30e-4831-b7ac-b8eff74e2f08 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:10.915849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.916652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.916941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.917222 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.925526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.927033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.934800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:10.936206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:10.936663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:10.936799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:10.942217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:10.943272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 253/507] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:10.948892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:10.954136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:10.955727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:10.974907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:10.975929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:10.976955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:10.976955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:10.976955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:10.976955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:10.977196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 255/508] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:10.978234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.057896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577cff5-bdbf-4545-89cc-523535897de4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.102044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:11.113970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ffea5-43af-4e1e-92ac-502df5e8e27e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.115330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.116541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.117014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.117495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.134792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.136856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.158138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.159530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:11.159937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:11.161450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:11.163161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:11.163161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:11.163161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:11.163161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:11.163458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.163458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.163696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 254/509] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:11.167671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.175384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.177279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.192621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:11.195519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:11.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:11.197487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:11.197487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:11.197487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:11.197487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:11.197487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 256/510] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:11.197767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.291431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b359c7-fd6c-4349-a67e-825312010233 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.313763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da839-6ec6-4d0c-a3d2-521af026b64b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.336028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.336772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.337060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.337344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.338080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:11.338419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.339801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.350638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.351321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.351604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.352138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.352421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 255/511] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:11.352731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:11.353044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.353245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.354527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.373807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 257/512] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:11.374722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.378999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:11.469328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:11.490964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e2e7-c449-40f4-a679-7c9780374090 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.505237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ced5-76ba-4b62-b47d-95bc00dc6b18 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.532048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.532724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.533007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.533290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.534024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:11.534366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.535770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.543985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.544591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.544913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.545189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.545935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:11.546283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.547680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.547958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 256/513] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:11.548800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.564560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 258/514] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:11.564560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.637709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:11.666757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce364-11ca-44d9-bcf3-5f472077b241 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.687708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d20f-0975-4ae8-8173-7726234c89b9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.713377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.714512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.715242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.715722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.717546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:11.717965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.719439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.729306 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:11.733319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 257/515] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:11.734674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.743541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.744360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.744644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.744920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.764054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.765572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:11.788751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:11.790509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 259/516] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:11.792349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.870194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfdce0-4077-4b54-8785-f62faa523aa7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.910022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.910968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.911346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.911758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.914286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b127a-69f9-4d87-a630-f5f0860247f7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:11.939738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:11.953140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:11.953936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:11.954248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:11.954585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:11.962308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:11.964017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:11.980204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:11.981675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 260/517] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:11.983217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:11.998534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:12.001293 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.003606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.095469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb7bc4-902f-428b-82f3-0aca63bf1304 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:12.128733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 258/518] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:12.130042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:12.136291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:12.136975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:12.137255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:12.137529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:12.138274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.140384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.176050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 261/519] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:00:11 2022] POST /identity/v3/users => generated 247 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:12.176050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:12.241718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:12.289027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:12.293047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165edf4-2be7-47d0-a667-e70695bb84d1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:12.338666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:12.339512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:12.339770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:12.340300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:12.349766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.351310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.358981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fdc42-49a8-40ef-9935-da114b574f23 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:12.369929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:12.370910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:00:12.371778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:12.372873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 259/520] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:12.372873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:12.422275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:12.423256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:12.423736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:12.424150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:12.425557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:12.426069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.428630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.462230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 262/521] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jul 21 10:00:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:12.462230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:12.502353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a5fa-1ac2-4a19-9de8-820175ec4439 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:12.549199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:12.549930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:12.550394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:12.550998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:12.553471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:12.553471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.553471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.573446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:12.578693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645a042-e5d5-4e70-8a6e-6a9e4c557b3e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:12.590941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 260/522] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:12.590941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:12.615940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:12.621114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:12.622102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:12.622551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:12.623711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:12.637582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.639804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:12.662647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:12.664341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:12.667038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:12.667038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:12.667038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:12.667038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:12.667038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 263/523] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:12.667038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:12.713624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296403-7e75-4cad-9c51-6314e988524d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:12.757745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:12.758816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:12.758816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:12.759045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:12.759905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:12.760238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.761738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.782692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454a101-1e65-4b94-8670-4af2d0ddfc7a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:12.805253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 261/524] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jul 21 10:00:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:12.806137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:12.832825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:12.833495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:12.833779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:12.834055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:12.864675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:12.916442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:12.933374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:12.935913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:12.955059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52832c6c-8d6f-49ad-96b4-12c1402aa99f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.006222 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:13.006926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:13.007284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:13.007635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:13.008503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=6d604a09f0e04fd2ac41f31a4e13e166) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:13.008823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:13.010350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:13.016538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 262/525] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:12 2022] GET /identity/v3/role_assignments?user.id=6d604a09f0e04fd2ac41f31a4e13e166&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:13.017390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:13.110989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 264/526] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:13.113022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:13.181000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:13.184318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fdbe-2b73-4953-8231-b8e1e2a0b613 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.226927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:13.228381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:13.228817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:13.229259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:13.230375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:13.230858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:13.233397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:13.244639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db168-c976-4044-88b0-ae393e4be944 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.249822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 263/527] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:13.251236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:13.255221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:13.293045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:13.294101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:13.294599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:13.295025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:13.415859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:13.418304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:13.426442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a15da-8e03-4095-9c85-ca2d56a63cd7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.474198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:13.475735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:13.476298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:13.476771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:13.489444 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:13.492216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:13.502587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:13.518889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:13.519938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:13.521190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:13.521190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:13.521190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:13.521190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:13.524445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 264/528] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:13.525701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:13.596752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 265/529] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:13.598773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:13.644289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:13.720603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fa60-96a8-4ec2-bdae-dc3221c20d19 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.726636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d176c1-1e62-4e47-bfcf-1ca0cd8e94c3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.767389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:13.768592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:13.769164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:13.769767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:13.770933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:13.771383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:13.772944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:13.777701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:13.778696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:13.779698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:13.780136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:13.794026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:13.795059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 266/530] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:13.796158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:13.797243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:13.812450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:13.824815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:13.826911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:13.827960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:13.834789 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 265/531] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:13.836006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:13.926437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3b36-15d1-42c4-beb5-5546ea292242 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.963636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f647be-ded0-4897-8d74-98ebdc9f43df None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:13.972272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:13.973384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:13.973832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:13.974305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:13.989290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:13.990449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:13.992616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:14.015563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:14.016693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:14.017745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:14.017745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:14.017745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:14.017745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:14.024488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:14.024488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.024488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.024488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.025141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 267/532] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:14.026399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:14.033135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:14.034738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:14.052451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:14.053544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:14.054388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:14.054793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 266/533] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:14.055858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:14.107775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:14.158765 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67f92-55a5-43e9-89f7-30b7ad9a3274 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:14.199337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:14.200296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.200823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.201317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.202387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:14.202980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:14.203611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af8c41-f3f0-47fb-8451-2752cbbd9e97 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:14.205638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.229138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 268/534] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:14.230550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:14.254634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:14.255324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.255614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.255897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.256652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:14.256966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:14.258443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.271725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 267/535] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:14.272622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:14.313221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:14.356917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04437b40-45f0-4a23-9084-6daa2e20bbef None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:14.385717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:14.388033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce843-09cc-4f73-916f-13e9571a6054 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:14.402804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:14.403989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.404475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.405023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.406031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:14.406563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:14.408557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.423288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 269/536] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:14.425167 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:14.432549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:14.433240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.433532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.433816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.434731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=164a361891274af1b20fe7b7458ecde6) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:14.435053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:14.437112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.443795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 268/537] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/role_assignments?user.id=164a361891274af1b20fe7b7458ecde6&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:14.444489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:14.596849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46157-c4be-466b-b3ba-50d2b18603ad None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:14.672071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23624-449c-48df-91a7-16b56bef1c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:14.673509 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:14.675659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23624-449c-48df-91a7-16b56bef1c11 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.676493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23624-449c-48df-91a7-16b56bef1c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.678142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23624-449c-48df-91a7-16b56bef1c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.680941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd8b34-7ec2-4543-8b6c-4d99c36f5bb2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:14.692806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc23624-449c-48df-91a7-16b56bef1c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:14.695882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc23624-449c-48df-91a7-16b56bef1c11 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ccc23624-449c-48df-91a7-16b56bef1c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:14.714292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:14.715609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 270/538] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbc71d-c13c-45dd-aa57-7b77fc82dd47 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.718019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbc71d-c13c-45dd-aa57-7b77fc82dd47 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.719163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbc71d-c13c-45dd-aa57-7b77fc82dd47 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.723425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 271/539] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:14.724984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2757f-a686-4187-b3e9-c672d468b931 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.725268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2757f-a686-4187-b3e9-c672d468b931 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.725546 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2757f-a686-4187-b3e9-c672d468b931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.745002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7ce2757f-a686-4187-b3e9-c672d468b931 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:14.746248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7ce2757f-a686-4187-b3e9-c672d468b931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:14.765616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:14.766998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:14.768040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:14.768538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:14.770147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=efc3534120be42ce9bc7ebb6f2a8fbc5) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:14.771559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:14.774718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:14.783657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 269/540] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/role_assignments?user.id=efc3534120be42ce9bc7ebb6f2a8fbc5&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:14.784213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:14.808101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:14.894659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 272/541] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:00:14.911503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2757f-a686-4187-b3e9-c672d468b931 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:15.044435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a4169-1a99-40dd-9009-b84c985d2d59 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:15.127826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:15.129362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:15.130158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:15.130959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:15.133131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:15.133886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:15.140398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:15.171706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 270/542] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:15.182860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:15.184512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2757f-a686-4187-b3e9-c672d468b931 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:15.237116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:15.256634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7498b-107d-471d-8846-4c90ac786daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:15.259764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7498b-107d-471d-8846-4c90ac786daf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:15.265263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7498b-107d-471d-8846-4c90ac786daf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:15.266200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7498b-107d-471d-8846-4c90ac786daf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:15.298124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7498b-107d-471d-8846-4c90ac786daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9dd7498b-107d-471d-8846-4c90ac786daf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:15.313606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:15.314630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:15.315390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:15.316522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 273/543] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:15.318878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da73e6e-6a6b-4041-8161-383ce5383484 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:15.319373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da73e6e-6a6b-4041-8161-383ce5383484 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:15.319847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da73e6e-6a6b-4041-8161-383ce5383484 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:15.327308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 274/544] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:15.327308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da73e6e-6a6b-4041-8161-383ce5383484 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:15.372327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:15.383774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184814df-f54a-4733-9018-8f15143c66dc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:15.437676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3555003-63b7-4513-9ed7-44901fd43889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:15.438656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3555003-63b7-4513-9ed7-44901fd43889 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:15.438954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3555003-63b7-4513-9ed7-44901fd43889 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:15.439237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3555003-63b7-4513-9ed7-44901fd43889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:15.440386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3555003-63b7-4513-9ed7-44901fd43889 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=dc579eaf4c3e4ea5a77063ba5f3d4b99) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:15.440709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3555003-63b7-4513-9ed7-44901fd43889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:15.442671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3555003-63b7-4513-9ed7-44901fd43889 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:15.454277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 271/545] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:15 2022] GET /identity/v3/role_assignments?user.id=dc579eaf4c3e4ea5a77063ba5f3d4b99&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:15.455791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343dccd-e60f-46cd-9f3e-c60233f09db0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:15.456087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343dccd-e60f-46cd-9f3e-c60233f09db0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:15.456372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343dccd-e60f-46cd-9f3e-c60233f09db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:15.483831 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da73e6e-6a6b-4041-8161-383ce5383484 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:15.510382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1343dccd-e60f-46cd-9f3e-c60233f09db0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:15.512310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1343dccd-e60f-46cd-9f3e-c60233f09db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:15.588049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:15.589051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:15.590523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:15.591008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:15.593308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:15.593821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:15.596496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:15.626254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 275/546] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:15.633045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:15.703965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 272/547] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:15.738559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343dccd-e60f-46cd-9f3e-c60233f09db0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:15.777097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:15.866656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:15.900471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885a05c-addc-4865-a4b5-8cbdd4d7daa8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:15.960543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343dccd-e60f-46cd-9f3e-c60233f09db0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:16.006880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:16.007963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:16.008399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:16.008822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:16.029187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:16.030386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:16.030880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:16.031304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:16.032907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:16.034804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:16.059936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:16.078299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:16.079479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:16.080489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:16.081140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:16.082432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:16.083439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:16.083439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:16.083439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:16.083439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:16.083439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 276/548] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:16.085477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 273/549] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:16.091268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:16.092384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:16.262511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f191a-92b9-4745-811d-454ee9a1ece6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:16.270611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:16.313345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:16.314148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:16.314539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:16.314896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:16.315754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:16.316139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:16.317656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:16.329243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 274/550] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:16.330960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd0efa-c895-46a1-a73d-dc10bd58ea34 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:16.335965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:16.385733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:16.387007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:16.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:16.388601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:16.390305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:16.391042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:16.392737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:16.407956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 277/551] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:16.423384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:16.442600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:16.647643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b641a-12cf-40c5-bd7b-501499201878 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:16.653331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7b52f-6701-4fe2-8bf0-ca438b3814e2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:16.711805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:16.712626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:16.712928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:16.713193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:16.721618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:16.729020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:16.730866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:16.752686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:16.753788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:16.754698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:16.754698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:16.754698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:16.754698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:16.755877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 275/552] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:16.765219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:16.766618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:16.770203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:16.770203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:16.770203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:16.788675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:16.790209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:16.817593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:16.818609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:16.819587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:16.823279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 278/553] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:16.830941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:16.972989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee500ffb-bc86-4779-8220-842a6ace55aa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:16.978573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:17.051059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46206b28-260a-4bbd-8ca6-41740dbba2d7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:17.053449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:17.054139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.054453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.054734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.055490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:17.055805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:17.057224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:17.086424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 276/554] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:17.091656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:17.134681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:17.135388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.135671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.135944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.136815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:17.137126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:17.138695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:17.182720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 279/555] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jul 21 10:00:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:17.187169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:17.188875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:17.290302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946aed-17d3-4bbf-b147-d4e855e08eb2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:17.332448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04a1e-24d0-4f62-ac92-f373510c2ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:17.333882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04a1e-24d0-4f62-ac92-f373510c2ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.334684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04a1e-24d0-4f62-ac92-f373510c2ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.335108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04a1e-24d0-4f62-ac92-f373510c2ba5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.352135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd04a1e-24d0-4f62-ac92-f373510c2ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:17.355694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd04a1e-24d0-4f62-ac92-f373510c2ba5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:17.362133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca094f4-edee-4215-8399-782752c2da8a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8cd04a1e-24d0-4f62-ac92-f373510c2ba5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:17.388929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:17.390600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:17.392717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 277/556] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:00:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:17.393657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730beac2-2e11-4e1b-bd9c-229a4d502249 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.393657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730beac2-2e11-4e1b-bd9c-229a4d502249 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.393864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730beac2-2e11-4e1b-bd9c-229a4d502249 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.402879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 278/557] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:17.402879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730beac2-2e11-4e1b-bd9c-229a4d502249 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:17.405389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:17.425674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa4d95-43a6-4740-9490-5a902fdcc4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:17.426882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa4d95-43a6-4740-9490-5a902fdcc4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.427335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa4d95-43a6-4740-9490-5a902fdcc4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.428078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa4d95-43a6-4740-9490-5a902fdcc4d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.539213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa4d95-43a6-4740-9490-5a902fdcc4d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:17.542121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa4d95-43a6-4740-9490-5a902fdcc4d3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:17.581982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730beac2-2e11-4e1b-bd9c-229a4d502249 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:17.598736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:17.637299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08ff2f-6892-4df1-895b-0fc9492d7248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:17.638405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ff2f-6892-4df1-895b-0fc9492d7248 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.639537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ff2f-6892-4df1-895b-0fc9492d7248 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.639537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ff2f-6892-4df1-895b-0fc9492d7248 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.640794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08ff2f-6892-4df1-895b-0fc9492d7248 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:17.641110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08ff2f-6892-4df1-895b-0fc9492d7248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:17.642792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08ff2f-6892-4df1-895b-0fc9492d7248 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:17.673496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 279/558] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:00:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:17.675612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f5146-f05d-4eef-869c-fa97a9f79b17 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.676113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f5146-f05d-4eef-869c-fa97a9f79b17 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.676611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f5146-f05d-4eef-869c-fa97a9f79b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.688318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 280/559] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:17.691111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060292b8-40ee-405b-8890-0d13080815fe None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.691737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060292b8-40ee-405b-8890-0d13080815fe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.692505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060292b8-40ee-405b-8890-0d13080815fe None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.695433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c15f5146-f05d-4eef-869c-fa97a9f79b17 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:17.695624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 281/560] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:17.696666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c15f5146-f05d-4eef-869c-fa97a9f79b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:17.697273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060292b8-40ee-405b-8890-0d13080815fe None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:17.735390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:17.794076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 280/561] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:17.794922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f5146-f05d-4eef-869c-fa97a9f79b17 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:17.841243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060292b8-40ee-405b-8890-0d13080815fe None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:17.875883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffb656-71cc-4cf5-81df-7d2c67a561b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:17.876741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb656-71cc-4cf5-81df-7d2c67a561b1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.877031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb656-71cc-4cf5-81df-7d2c67a561b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.877303 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb656-71cc-4cf5-81df-7d2c67a561b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.887495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffb656-71cc-4cf5-81df-7d2c67a561b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:17.889536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffb656-71cc-4cf5-81df-7d2c67a561b1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:17.904014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-92ffb656-71cc-4cf5-81df-7d2c67a561b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:17.907247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:17.908158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:17.909030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:17.909030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:17.909030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:17.909030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:17.909246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f5146-f05d-4eef-869c-fa97a9f79b17 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:17.909325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 282/562] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:17.909761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04615a-f60d-4d3b-9cba-43bec121d5ce None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.910054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04615a-f60d-4d3b-9cba-43bec121d5ce None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.910353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04615a-f60d-4d3b-9cba-43bec121d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.926707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bb04615a-f60d-4d3b-9cba-43bec121d5ce None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:17.927915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bb04615a-f60d-4d3b-9cba-43bec121d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:17.943727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:17.944529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:17.944813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:17.945095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:17.956151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:17.957595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:17.975656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:17.976664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:17.978238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:17.978238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:17.978238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:17.978238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:17.978238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 281/563] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:17.978238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.010459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 283/564] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:18.011803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38034-7b04-4b98-bfaf-f4b7f5770ac1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.012087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38034-7b04-4b98-bfaf-f4b7f5770ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.012360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38034-7b04-4b98-bfaf-f4b7f5770ac1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.014250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 284/565] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:18.014948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38034-7b04-4b98-bfaf-f4b7f5770ac1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.023616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.096595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810f6f4-e6c9-42e7-a77b-86c856eac169 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.115998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38034-7b04-4b98-bfaf-f4b7f5770ac1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.131275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.132072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.132357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.132638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.143416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:18.151284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:18.152216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:18.153035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 282/566] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:18.153745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d30948-fcb9-4322-b9d4-09e748c64e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.153745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d30948-fcb9-4322-b9d4-09e748c64e8a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.153906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.153977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d30948-fcb9-4322-b9d4-09e748c64e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.153977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d30948-fcb9-4322-b9d4-09e748c64e8a None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.154606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d30948-fcb9-4322-b9d4-09e748c64e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:18.154912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d30948-fcb9-4322-b9d4-09e748c64e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:18.156290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d30948-fcb9-4322-b9d4-09e748c64e8a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:18.169452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 285/567] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:18.170973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e01e-90bc-413e-ba6b-7d517a596c6c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.171315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e01e-90bc-413e-ba6b-7d517a596c6c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.171598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e01e-90bc-413e-ba6b-7d517a596c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.173982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.189740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9f19e01e-90bc-413e-ba6b-7d517a596c6c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:18.191000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9f19e01e-90bc-413e-ba6b-7d517a596c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:18.262439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.272422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 286/568] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:18.273284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19e01e-90bc-413e-ba6b-7d517a596c6c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.291337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a39ca-f082-485b-9244-21fb27a5d9ed None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.336988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.337663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.338025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.338537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.339822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:18.340587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:18.342931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:18.363853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 283/569] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:18.365198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.397610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19e01e-90bc-413e-ba6b-7d517a596c6c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.445306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.446112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.446440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.446704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.454922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.458206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:18.466310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:18.467472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 287/570] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:18.468821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.492315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3148255-928d-475f-b6b2-0af6a4442f05 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.528316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.528988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.529269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.529547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.530337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:18.530848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:18.532237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:18.532568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.540664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 284/571] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:18.541584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.590232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17226c6-00cb-44ca-a006-0166942412f4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.624307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.625081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.625365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.625642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.632879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:18.634368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:18.644885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c31a-7f1d-401c-a2c5-47c920465924 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:18.650119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:18.651007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:18.651871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 288/572] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:18.652628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.679365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.684981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.685781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.686066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.686379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.696812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:18.704831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:18.705874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:18.707049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 285/573] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:18.707843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.764745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0a428-2bd6-45cf-a781-0bff48b72459 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.781985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.801249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.802055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.802364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.802643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.809289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:18.810793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:18.811591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed8e1a-08bf-4131-bf6c-1b0dac0e1893 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:18.824515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:18.825437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 289/574] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:18.826809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.853685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.854397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.854686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.854966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.855732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:18.856045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:18.857982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:18.866002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 286/575] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:18.866843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:18.921657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:18.938012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71133fd-20a8-42d7-af81-4dd7ad7de4ca None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.965425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5684e-ed9a-46c0-9598-30de6bb5e835 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:18.971285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:18.972096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:18.972374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:18.972646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:18.992770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:18.994261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.002711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.003401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.003691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.003972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.004780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:19.005096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.006816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:19.011674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:19.012758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:19.014159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:19.014159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:19.014159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:19.014159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:19.014159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 290/576] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:19.014159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.034220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 287/577] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:19.034943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.048480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:19.125375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930644-9b44-41e5-b202-e2380b66ccf2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.143468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c9ce8-fc05-4954-965a-aff97097e5de None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.160626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:19.166908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.167601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.167996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.168454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.169832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:19.170402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.172472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.181650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 291/578] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:19.182457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.190210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.190915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.191202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.191481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.192295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:19.192610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.194048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.207871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 288/579] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:19.208708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.277921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:19.288572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6d98-00a1-405a-8d18-4c1dcda3687d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.310441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873c40-8960-4e1c-a39c-8c615d94e693 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.322138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.322984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.323269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.323537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.334856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.336305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.352850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.353524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.353807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.354083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.354871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:19.355181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.356560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:19.360767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:19.361661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:19.362631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:19.362631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:19.362631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:19.362631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:19.362631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 292/580] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:19.363775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.375390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 289/581] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:19.376274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.413371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:19.480824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caafbc-ace7-4240-88a5-cc246408cb52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.490409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea451fa-21a3-4f91-935b-7785fe317f09 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.517849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.518676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.518966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.519247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.524799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.525686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.525965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.526262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/6d604a09f0e04fd2ac41f31a4e13e166/roles/8bbb1d5f1b1047ffa69f7573478e9e6e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.529124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.530625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.538059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:19.541804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=6d604a09f0e04fd2ac41f31a4e13e166, role_id=8bbb1d5f1b1047ffa69f7573478e9e6e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.543608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:19.548466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:19.550940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:19.552051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:19.552051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:19.552051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:19.552051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:19.552051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 290/582] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:19.552051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.561097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 293/583] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:19 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/6d604a09f0e04fd2ac41f31a4e13e166/roles/8bbb1d5f1b1047ffa69f7573478e9e6e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:19.561738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.657867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:19.678288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0caf02-dc75-48e4-946d-fd4b02ea3557 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.682652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c4e62-8e5a-4805-91b1-75e7a64d414f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.726625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.727296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.727576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.727670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.727854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.728276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.728561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.728714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=72498fa7138e4308affc50fa1b1a78fd) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:19.728838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.729032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.729568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:19.729877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.730558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.731458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.738000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 291/584] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/role_assignments?user.id=72498fa7138e4308affc50fa1b1a78fd&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:19.738943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.745855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 294/585] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:19.747112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.824976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:19.896727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51cbc0-1456-432f-a142-c27f69e32263 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.912045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818d7c4-65aa-40a0-b758-c63c2bb38ed9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:19.953629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.955192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.956267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.957111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.958476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:19.959024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.960726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:19.961538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:19.961655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.961808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:19.962084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:19.972142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:19.973593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:19.982869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 295/586] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:19.983433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:19.990119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:19.991084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 292/587] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:19.993635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.006568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.114471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98a7a-7667-4c74-9c50-f915ea954d44 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.127049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2281a-9bd7-4ffe-8086-1f461f97879d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.129252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.153496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.154410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.154691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.154963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.163920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.164219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.164799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.165137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.165421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.165630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.173708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.175247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:20.183424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:20.184376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:00:20.185838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:20.190153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 296/588] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:20.191082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:20.191308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:20.193366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 293/589] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:20.195790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.277981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.318618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f150-19ff-469a-acc6-5b9aceeaaf79 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.324608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f523cc0-3625-4520-9371-f057099bdb53 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.358140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.359110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.359490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.359931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.360873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:20.361277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.363053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.371225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.371920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.373017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.373303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.374945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:20.375268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.376780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.384607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 297/590] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:20.385819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.401083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 294/591] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:20.402462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.423412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.508133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79cad-09bd-4ed8-bfa6-2a4948e237ed None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.520673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ee4d-d2b6-4fd1-909e-2acd51be929d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.545895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.546769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.547051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.547330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.548170 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:20.548475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.549925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.558610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.576999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 298/592] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:20.576999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.578243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.579827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.581338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.581834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.597949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.599782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:20.621118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:20.622074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:20.623013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:20.623013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:20.623013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:20.623013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:20.625257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 295/593] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:20.626371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.691334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.708085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bd18e-6638-442d-ab69-7da6b4df5b12 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.753876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.754749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.755035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.755312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.767441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.768796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.774517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5389d7e-84d1-4f38-a45f-ba1dc99c830b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:20.788139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:20.789048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:20.789906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:20.789906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:20.789906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:20.789906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:20.794090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 299/594] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:20.795837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.826066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.827478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.827935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.828383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.848615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.850909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:20.873058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:20.873971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:20.874885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:20.874885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:20.874885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:20.874885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:20.877178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 296/595] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:20.878328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:20.917392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a184c-f20f-4aaa-97fe-b5838767b5c4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:20.918084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.958231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:20.958912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:20.959195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:20.959463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:20.960198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:20.960506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:20.961901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:20.973936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:20.978766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 300/596] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:20.979889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.021161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c84474-2f1c-4ee8-ba15-113974689503 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.061157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.061922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.062307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.062659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.063487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:21.063867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.065399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.082421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 297/597] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:21.083548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.104752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cadf2-38a6-4c58-84ce-9f06a144a60c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.149743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.150989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.151369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.151758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.152926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:21.153307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.155343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.174320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 301/598] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:21.175497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.213549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:21.225525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0d37-ff7b-45bd-ad86-346dbee4e22e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.260530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:21.270666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.272073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.273129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.273617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.284197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.286404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:21.306673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:21.307607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:21.308477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:21.311076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 298/599] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:21.312269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.320910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c842e3d-3e9f-4b2c-ab87-29c49044e13d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.366674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.367561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.367943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.368352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.377739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.379723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:21.399874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:21.401811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:21.404494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 302/600] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:21.405635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.504251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c7c8-1c2f-4d60-b9a7-c096e06b99bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.543277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.544754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.545157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.545581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.553230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.554845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.566580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681e5c-ffd7-48ba-8e2c-1307ff60e11d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:21.570847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:21.572676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:21.574714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:21.579213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 299/601] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:21.580247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.597273 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:21.607263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:21.623998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.624913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.625338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.625751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.626706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:21.627155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.629253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.645938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 303/602] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:21.647305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.696038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361eb5-403f-448d-90de-c24066fd4fd7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.732774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.733601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.734000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.734480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.735317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:21.735743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.737270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.752349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 300/603] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:21.753171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.779076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98354f-3191-4236-a4d8-97e1b00e66ad None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.815527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57552b7d-dc0a-499f-9c92-24b11d857e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.816206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552b7d-dc0a-499f-9c92-24b11d857e6f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.816489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552b7d-dc0a-499f-9c92-24b11d857e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.816764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552b7d-dc0a-499f-9c92-24b11d857e6f None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.817556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57552b7d-dc0a-499f-9c92-24b11d857e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:21.817863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57552b7d-dc0a-499f-9c92-24b11d857e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.819361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57552b7d-dc0a-499f-9c92-24b11d857e6f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.830936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 304/604] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:21.832170 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07723ed5-cf30-422f-817b-26cb0e1c0692 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.832455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07723ed5-cf30-422f-817b-26cb0e1c0692 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.832728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07723ed5-cf30-422f-817b-26cb0e1c0692 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.834091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 305/605] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:21.834632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07723ed5-cf30-422f-817b-26cb0e1c0692 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.842221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:21.878609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db9721-5fd6-40a1-971a-eaf030e4432e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.885635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:21.913871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.914784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.915065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.915339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/efc3534120be42ce9bc7ebb6f2a8fbc5/roles/8bbb1d5f1b1047ffa69f7573478e9e6e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:21.930233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=efc3534120be42ce9bc7ebb6f2a8fbc5, role_id=8bbb1d5f1b1047ffa69f7573478e9e6e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:21.931674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:21.945536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 301/606] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:21 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/efc3534120be42ce9bc7ebb6f2a8fbc5/roles/8bbb1d5f1b1047ffa69f7573478e9e6e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:21.946453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:21.948775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07723ed5-cf30-422f-817b-26cb0e1c0692 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:21.991355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6edd6b-ac3b-4636-b88e-c3388502fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:21.992267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6edd6b-ac3b-4636-b88e-c3388502fb18 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:21.992552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6edd6b-ac3b-4636-b88e-c3388502fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:21.992822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6edd6b-ac3b-4636-b88e-c3388502fb18 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/164a361891274af1b20fe7b7458ecde6/roles/8bbb1d5f1b1047ffa69f7573478e9e6e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.009700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6edd6b-ac3b-4636-b88e-c3388502fb18 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=164a361891274af1b20fe7b7458ecde6, role_id=8bbb1d5f1b1047ffa69f7573478e9e6e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:22.011263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6edd6b-ac3b-4636-b88e-c3388502fb18 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:22.026856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 306/607] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:21 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/164a361891274af1b20fe7b7458ecde6/roles/8bbb1d5f1b1047ffa69f7573478e9e6e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:22.027980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4afe2-1bf1-4d85-ae07-8ed8e673879a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.028271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4afe2-1bf1-4d85-ae07-8ed8e673879a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.028547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4afe2-1bf1-4d85-ae07-8ed8e673879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.054132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5ce4afe2-1bf1-4d85-ae07-8ed8e673879a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:22.055752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5ce4afe2-1bf1-4d85-ae07-8ed8e673879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:22.108006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2dbc-a3c4-4778-8645-b76f2117c7e2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:22.144110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:22.157208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 307/608] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:22.159731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593644-579e-467f-9986-e7079fc445a8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.160017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593644-579e-467f-9986-e7079fc445a8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.160292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593644-579e-467f-9986-e7079fc445a8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.161853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 308/609] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:22.166227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:22.166988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.167274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.167549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/dc579eaf4c3e4ea5a77063ba5f3d4b99/roles/8bbb1d5f1b1047ffa69f7573478e9e6e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.169915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e7c4-3501-46da-976e-b0070d98f09d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.170242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e7c4-3501-46da-976e-b0070d98f09d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.170484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e7c4-3501-46da-976e-b0070d98f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.190523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=dc579eaf4c3e4ea5a77063ba5f3d4b99, role_id=8bbb1d5f1b1047ffa69f7573478e9e6e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:22.191630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-67c0e7c4-3501-46da-976e-b0070d98f09d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:22.192791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:22.192916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67c0e7c4-3501-46da-976e-b0070d98f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:22.210831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 302/610] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:21 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/dc579eaf4c3e4ea5a77063ba5f3d4b99/roles/8bbb1d5f1b1047ffa69f7573478e9e6e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:22.212017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:22.219094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:22.332758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25124b-dfdb-40ad-9499-793e8ee1c82c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:22.340958 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 309/611] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:22.373514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:22.374625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.375028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.375381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.381200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0e7c4-3501-46da-976e-b0070d98f09d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:22.389579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:22.398130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:22.399107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:22.400336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 303/612] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:22.407423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:22.452622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:22.535504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2612-2fef-4cb2-8ad5-ff689364ee94 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:22.538049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0e7c4-3501-46da-976e-b0070d98f09d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:22.577924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:22.582192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.582192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.582192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.582192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:22.582192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:22.582192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:22.606197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 304/613] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:22.606197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:22.607816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:22.610051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.610051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.610051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.638195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:22.646199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:22.647169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:22.648813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 310/614] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:22.650154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:22.671904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:22.738204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d34f-76ab-47fc-8b36-e9a7b0cb9199 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:22.742499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:22.777041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:22.778070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.778449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.779445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.792223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:22.793823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:22.813981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:22.816138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:22.818068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:22.818068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:22.818068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:22.818068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:22.818068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 305/615] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:22.823831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:22.893183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f269-152e-48f6-a610-1479b348c7b6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:22.948967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:22.949600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:22.949828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:22.950108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:22.950951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:22.951261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:22.952660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:22.969845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16eb68-dbb5-4fd0-8f39-7c95da14430c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:22.987728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 311/616] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:22.996368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:23.006098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:23.006802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:23.007091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:23.007377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:23.008122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:23.008437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:23.009830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:23.023181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 306/617] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:23.040538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:23.062760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:23.199593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:23.265312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e7c4-f890-4a20-9d79-c76eacdd4a45 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:23.313550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289004b1-7831-4e55-918c-6c8f45b32de4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:23.359279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:23.360119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:23.360402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:23.360675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:23.363615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:23.364497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:23.364783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:23.365059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:23.369821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:23.371559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:23.388582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:23.389555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:23.390533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 307/618] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:00:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:23.396058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:23.398760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:23.400472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:23.439021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:23.441271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:23.443489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:23.443489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:23.443489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:23.443489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:23.443489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 312/619] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:23.447686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:23.499811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:23.572302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298df68-b9c2-4ad4-a914-45062d802ac2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:23.647799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd27f-74ab-4d8f-b6db-e9dd83ff6e27 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:23.652343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:23.653028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:23.653310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:23.653691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:23.654582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:23.654891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:23.656413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:23.698533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:23.698728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 308/620] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:00:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:23.704917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:23.705255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:23.705608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:23.705892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:23.706180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:23.707258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:23.707637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:23.709114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:23.724358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 313/621] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:23.730049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:23.849689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba7a25-53a1-4703-bbad-cfae8ca481c8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:23.868155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a20073-4901-4d59-9391-88c986522c89 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:23.892731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:23.893542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:23.893822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:23.894098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:23.909121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:23.910276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:23.912771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:23.931250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:23.931909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:23.932195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:23.932473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:23.939666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:23.940581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:23.941506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 314/622] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:23.953484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.010051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:24.064369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c335-f98c-4257-906f-065a484e9a4d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:24.102149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:24.102810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.103097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.103377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.104406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:24.104724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:24.106197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:24.127052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 315/623] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jul 21 10:00:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:24.133348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.187111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:24.188600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:24.250551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017129b-df9d-48e0-93d8-2eb5cb5378f3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:24.252604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:24.309865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:24.310711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.310994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.311271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.330851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:24.332823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:24.370861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 309/624] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:24.371295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:24.372150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:24.373061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:24.373061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:24.373061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:24.373061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:24.373061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 316/625] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:24.383278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.383801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.432042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:24.530156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfd92e-0895-48d1-b5e0-52496b3c441b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:24.532179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3e6b1-f238-42f3-8ee0-f500edfb3fe8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:24.566877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1a01e-7ee3-4410-afc2-c8a2c6674f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:24.568110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1a01e-7ee3-4410-afc2-c8a2c6674f94 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.568641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1a01e-7ee3-4410-afc2-c8a2c6674f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.569097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1a01e-7ee3-4410-afc2-c8a2c6674f94 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.570112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1a01e-7ee3-4410-afc2-c8a2c6674f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:24.570571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dd72d-d97f-4629-95b8-3184b4a6ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:24.570773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1a01e-7ee3-4410-afc2-c8a2c6674f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:24.571616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dd72d-d97f-4629-95b8-3184b4a6ff1f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.571994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dd72d-d97f-4629-95b8-3184b4a6ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.572370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dd72d-d97f-4629-95b8-3184b4a6ff1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.572857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1a01e-7ee3-4410-afc2-c8a2c6674f94 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:24.592212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dd72d-d97f-4629-95b8-3184b4a6ff1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:24.592212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dd72d-d97f-4629-95b8-3184b4a6ff1f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:24.592635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 317/626] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:24.594483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198a4c-78c3-4b41-8bc9-9c46c5c2c259 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.594930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198a4c-78c3-4b41-8bc9-9c46c5c2c259 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.595357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198a4c-78c3-4b41-8bc9-9c46c5c2c259 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.597245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 318/627] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:24.598205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198a4c-78c3-4b41-8bc9-9c46c5c2c259 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.616150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-cd8dd72d-d97f-4629-95b8-3184b4a6ff1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:24.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:24.623123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:24.624068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:24.624068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:24.624068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:24.624068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:24.626444 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 310/628] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:24.628067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132db9c-6cb9-4dad-b95e-8718ff7f5b4d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.628590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132db9c-6cb9-4dad-b95e-8718ff7f5b4d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.629068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132db9c-6cb9-4dad-b95e-8718ff7f5b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.648738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b132db9c-6cb9-4dad-b95e-8718ff7f5b4d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:24.650518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b132db9c-6cb9-4dad-b95e-8718ff7f5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:24.733650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198a4c-78c3-4b41-8bc9-9c46c5c2c259 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:24.750891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 311/629] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:24.750891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132db9c-6cb9-4dad-b95e-8718ff7f5b4d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.768564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:24.784582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e3699-bd0b-404e-b5dd-68fab68db827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:24.785519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3699-bd0b-404e-b5dd-68fab68db827 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.785806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3699-bd0b-404e-b5dd-68fab68db827 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.786086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3699-bd0b-404e-b5dd-68fab68db827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.794305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e3699-bd0b-404e-b5dd-68fab68db827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:24.795772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e3699-bd0b-404e-b5dd-68fab68db827 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d05e3699-bd0b-404e-b5dd-68fab68db827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:24.811237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:24.812217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:24.813069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 319/630] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:24.813874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06065c-1478-4aa5-8b9f-32a6ee9be544 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.814092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06065c-1478-4aa5-8b9f-32a6ee9be544 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.814454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06065c-1478-4aa5-8b9f-32a6ee9be544 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.816411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 320/631] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:24.817918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4307a6-fb93-4a61-a4ff-634e0eb4f6ae None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.818236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4307a6-fb93-4a61-a4ff-634e0eb4f6ae None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.818581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4307a6-fb93-4a61-a4ff-634e0eb4f6ae None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.820080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 321/632] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:24.820718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4307a6-fb93-4a61-a4ff-634e0eb4f6ae None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.871493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132db9c-6cb9-4dad-b95e-8718ff7f5b4d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:24.903390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:24.911381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:24.912054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.912335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.912613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.913348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:24.913659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:24.915206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:24.927695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 312/633] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:24.928540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:24.929580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4307a6-fb93-4a61-a4ff-634e0eb4f6ae None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:24.966520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4d787-6108-41bf-8b59-cd9d50a84cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:24.967331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d787-6108-41bf-8b59-cd9d50a84cfc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.967615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d787-6108-41bf-8b59-cd9d50a84cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.967889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d787-6108-41bf-8b59-cd9d50a84cfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:24.979243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4d787-6108-41bf-8b59-cd9d50a84cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-daa4d787-6108-41bf-8b59-cd9d50a84cfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:24.987557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:24.988478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:24.989301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 322/634] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:24.989975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133293-e199-4ace-be60-cd77b83e8520 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:24.990332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133293-e199-4ace-be60-cd77b83e8520 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:24.990602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133293-e199-4ace-be60-cd77b83e8520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.005184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:25.007755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5f133293-e199-4ace-be60-cd77b83e8520 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:25.009056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5f133293-e199-4ace-be60-cd77b83e8520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:25.045139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804988e-bc41-4606-8e1f-9a0998480f66 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.079207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 323/635] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:25.082424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9faf45-de4b-4195-8b06-112daa44e60c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.082424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9faf45-de4b-4195-8b06-112daa44e60c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.082424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9faf45-de4b-4195-8b06-112daa44e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.091406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.092089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.092383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.092664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.093474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:25.093787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:25.095275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:25.099211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4a9faf45-de4b-4195-8b06-112daa44e60c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:25.100417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4a9faf45-de4b-4195-8b06-112daa44e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:25.114456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 313/636] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:25.115370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.164581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:25.175296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 324/637] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:25.176136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9faf45-de4b-4195-8b06-112daa44e60c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.232206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25b255-e727-406e-8376-fc181fef5763 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.258516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:25.267429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.268233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.268515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.268795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.275655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:25.277111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:25.282911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9faf45-de4b-4195-8b06-112daa44e60c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:25.291300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:25.292288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:25.293179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 314/638] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:25.293782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.322288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.322966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.323244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.323547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.324306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:25.324609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:25.326034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:25.334375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 325/639] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:25.335184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.392295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:25.399119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0127-9105-446b-a684-5e72fa5f3b2f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.438606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.439338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.439627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.439906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.442194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428673d-ff4d-4a7c-9432-5388c416c54f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.450791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:25.458759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:25.459670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:25.460499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 315/640] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:25.461177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.488510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.489415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.489705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.489979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/72498fa7138e4308affc50fa1b1a78fd/roles/8bbb1d5f1b1047ffa69f7573478e9e6e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.505182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=72498fa7138e4308affc50fa1b1a78fd, role_id=8bbb1d5f1b1047ffa69f7573478e9e6e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:25.506675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:25.521510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:25.527364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 326/641] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:25 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/72498fa7138e4308affc50fa1b1a78fd/roles/8bbb1d5f1b1047ffa69f7573478e9e6e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:25.527364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.601990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5cb3c-b0fd-4369-bc9f-a91be26f2cbe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.648001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.649384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.649892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.650432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.661763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59f8a-9e8f-4761-b829-cab8df24b055 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.665268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:25.670951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:25.674002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:25.675279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:25.676132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:25.681584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 316/642] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:25.681584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.717566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.718301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.718550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.718777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.719544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:25.719853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:25.721300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:25.742948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 327/643] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:25.743595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.815028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dc17c-eed7-46e0-8d31-13258de2d14b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.827834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:25.860618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.861492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.861772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.862093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.867927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13905345-9de0-48a9-b89d-0fb1f18242c3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:25.874421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:25.876397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:25.896836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:25.897783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:25.899315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:25.899315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:25.899315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:25.899315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:25.899315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 317/644] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:25.899315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.909378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:25.910056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:25.910376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:25.910650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:25.911407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:25.911710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:25.913101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:25.932454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 328/645] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:25.932454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:25.959952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:26.021041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e2bd6-0f17-4c36-9ae1-191a20098572 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.054658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e18cc-8c14-4da9-b51e-508c5ca5faed None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.063169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.063859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.064143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.064424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.065190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:26.065502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.067561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.079451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 318/646] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:26.080305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.094048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.095111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.095400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.095674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.096854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=6d604a09f0e04fd2ac41f31a4e13e166) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:26.097169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.098657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.107357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 329/647] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:25 2022] GET /identity/v3/role_assignments?user.id=6d604a09f0e04fd2ac41f31a4e13e166&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:26.107357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.124769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:26.236876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eac84-9e5b-40d5-8a1c-012c48b27e92 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.248319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:26.261915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733f55-6b31-472e-9c7b-46d91ad002ba None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.292934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.293684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.293975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.294358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.295101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:26.295415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.297495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.310634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.311483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.311764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.312035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.313593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 319/648] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:26.315264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.334280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.335751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:26.355262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:26.356181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:26.357323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:26.357323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:26.357323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:26.357323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:26.357323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 330/649] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:26.357658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.445215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:26.468797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb22a7-465d-4504-a914-7f8c1aa6f18d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.512260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.513206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51153186-cb1a-44dd-8cf3-54bb7b77524f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.513354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.513620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.513973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.527662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.529406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:26.550770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:26.551866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:26.553084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:26.553084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:26.553084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:26.553084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:26.553836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 320/650] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:26.554582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.568775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.569946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.570550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.571222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.584276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.586436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:26.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:26.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:00:26.607807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:26.609060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 331/651] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:26.609060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.615137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:26.702536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f33be-b7ec-4356-8a60-51d0bca54bb5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.758234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589749-48e0-4b5a-8922-d4d968d2e0ae None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.758532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:26.763367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.764430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.764948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.765413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.766405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:26.766935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.768552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.785661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 321/652] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:26.786887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.807349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.807979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.808265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.808540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.809650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:26.810493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.811927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.834917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 332/653] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:26.835899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:26.902645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996ab89-c39d-4a73-bd51-6dc8ac2a79f4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.915950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:26.942140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:26.943154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:26.943641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:26.944107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:26.945233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:26.945782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:26.947650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:26.963258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d341df-d8a8-48a0-ae95-b3ee08d059b1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:26.971541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 322/654] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:26.972444 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.005033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:27.006256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.006740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.007234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.015907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:27.017682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:27.035419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:27.036482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:00:27.037421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:27.040665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 333/655] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:27.041096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:27.042945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.116161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c90dd-cf3d-4eb7-9590-f19afa511f1c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:27.156218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257feae8-7f5c-47f9-a58f-dcf130560d34 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:27.164414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:27.165843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.166210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.166497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.177252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:27.179205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:27.195144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:27.202195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:27.203159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:00:27.204086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:27.206248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 323/656] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:27.207300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.216562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:27.217798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.218336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.218809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.293220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:27.295123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:27.339775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67142e-6321-4e8b-9962-e666f9012593 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:27.353397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:27.383779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:27.384805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.385305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.385779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.387053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:27.387588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:27.389965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:27.411311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 324/657] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jul 21 10:00:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:27.412634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.429477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 334/658] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:27.430530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.474551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:27.553126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae2ae3-d8bc-46fe-a1f9-df3b5b005b28 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:27.578685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ce5ac-962b-406d-80eb-8af244f94bd6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:27.604309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:27.605962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.606630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.607121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.608501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:27.609412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:27.611695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:27.617457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:27.618287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.618573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.618892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.645583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 325/659] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jul 21 10:00:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:27.645583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.682736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:27.703131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:27.704613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:27.733823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:27.776630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736be06-9f7e-4a6b-b9ca-2060d3b57e3f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:27.815965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a213537-5a15-41e6-9535-6c5df5638ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:27.816779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a213537-5a15-41e6-9535-6c5df5638ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.817399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a213537-5a15-41e6-9535-6c5df5638ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.817684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a213537-5a15-41e6-9535-6c5df5638ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.828527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 335/660] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:27.828527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.834566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a213537-5a15-41e6-9535-6c5df5638ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:27.836065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a213537-5a15-41e6-9535-6c5df5638ce9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4a213537-5a15-41e6-9535-6c5df5638ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:27.857300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:27.858921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:27.859822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:27.859822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:27.859822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:27.859822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:27.859822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 326/661] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:27.860089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050fee4-ab99-46f2-a77b-be34f51735a7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:27.860165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050fee4-ab99-46f2-a77b-be34f51735a7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:27.860536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050fee4-ab99-46f2-a77b-be34f51735a7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:27.865879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 327/662] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:27.866803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050fee4-ab99-46f2-a77b-be34f51735a7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:27.947213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c59d0-0c58-4014-b588-2750f4c70bd8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:27.967030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:27.989556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:28.001420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050fee4-ab99-46f2-a77b-be34f51735a7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.007048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93edff5-2397-41ca-8a8e-4d29d552cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.008089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edff5-2397-41ca-8a8e-4d29d552cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.008536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edff5-2397-41ca-8a8e-4d29d552cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.008968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edff5-2397-41ca-8a8e-4d29d552cfa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.048653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.049839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.050333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.050641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.061367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.062846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:28.082218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:28.083170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:28.084593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:28.084593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:28.084593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:28.084593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:28.084593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 328/663] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:28.084593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.103179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93edff5-2397-41ca-8a8e-4d29d552cfa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.104636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93edff5-2397-41ca-8a8e-4d29d552cfa4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.199587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0431250-edec-47fe-b618-18d52680ea6f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.229904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 336/664] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:28.231821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:28.231989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4421-5023-456c-ae0d-d866bcc99112 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.232282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4421-5023-456c-ae0d-d866bcc99112 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.232560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4421-5023-456c-ae0d-d866bcc99112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.238955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.239927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.240216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.240501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.241246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:28.241561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.243001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.250075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-952b4421-5023-456c-ae0d-d866bcc99112 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:28.251331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-952b4421-5023-456c-ae0d-d866bcc99112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:28.259709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 329/665] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:28.259709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.274143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:28.342563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 337/666] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:28.344570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4421-5023-456c-ae0d-d866bcc99112 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.381891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22033387-e066-4fad-bc43-f6fce5a35fd0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.424616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.425738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.426223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.426516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.427288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:28.427573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.428960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.448313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 330/667] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:28.448313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.474362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4421-5023-456c-ae0d-d866bcc99112 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.504896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:28.511914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.512786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.513572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.513849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.524578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.526055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:28.544445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:28.545377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:28.552735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:28.552735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:28.552735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:28.552735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:28.552735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 338/668] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:28.552735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.555853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f26f3-4867-4335-a71d-72a43253020e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.559267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:28.591267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.592073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.592352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.592624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.599694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.601167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:28.615395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:28.616329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:28.617189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 331/669] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:28.617689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.664795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa492f8f-d0bc-48df-9c56-5033bec17c31 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.701584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffbfa9-b2e3-472c-938e-48eea9f679eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.703202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffbfa9-b2e3-472c-938e-48eea9f679eb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.703479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffbfa9-b2e3-472c-938e-48eea9f679eb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.703745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffbfa9-b2e3-472c-938e-48eea9f679eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.717627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffbfa9-b2e3-472c-938e-48eea9f679eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f6ffbfa9-b2e3-472c-938e-48eea9f679eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:28.725777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:28.726987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:28.727920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 339/670] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:28.728974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2b2a-1cea-4621-833c-73fde13986a7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.728974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2b2a-1cea-4621-833c-73fde13986a7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.728974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2b2a-1cea-4621-833c-73fde13986a7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.730738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 340/671] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:28.731181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae2b2a-1cea-4621-833c-73fde13986a7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.750389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954efba-ffc8-4a58-b26f-8ca867c29862 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.761469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:28.785729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.786563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.786846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.787125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.796155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.798894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.806550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:28.815850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:28.816875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:28.817779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 332/672] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:28.819172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.854448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae2b2a-1cea-4621-833c-73fde13986a7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.888410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.889085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.889372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.889650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.890411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:28.890722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.892095 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.903886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 341/673] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:28.904774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:28.920669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b35890-9b8f-49df-a6ed-5bc9d5db8c76 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:28.955191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14965e-3e9e-4b6b-9c11-9f308a104baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:28.955855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14965e-3e9e-4b6b-9c11-9f308a104baf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.956145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14965e-3e9e-4b6b-9c11-9f308a104baf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.956429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14965e-3e9e-4b6b-9c11-9f308a104baf None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.957241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14965e-3e9e-4b6b-9c11-9f308a104baf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:28.957562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14965e-3e9e-4b6b-9c11-9f308a104baf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:28.959111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14965e-3e9e-4b6b-9c11-9f308a104baf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:28.970857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 333/674] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:28.972018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7b70-48a0-4fa5-86a8-4564e641b932 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:28.972313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7b70-48a0-4fa5-86a8-4564e641b932 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:28.972598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7b70-48a0-4fa5-86a8-4564e641b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:28.989007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8fca7b70-48a0-4fa5-86a8-4564e641b932 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:28.990163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8fca7b70-48a0-4fa5-86a8-4564e641b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:29.006237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ad644-2d15-49c3-a342-214a6535b4c0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.013795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.031316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.040768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.041665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.042032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.042342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.043100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:29.043416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.045281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.053140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 342/675] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:29.053916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.061926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 334/676] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:29.062839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7b70-48a0-4fa5-86a8-4564e641b932 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.177801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7b70-48a0-4fa5-86a8-4564e641b932 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.182987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ad3e7-eb64-486f-b4c6-fe969ec2bcf3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.210942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.211843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.212127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.212399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.216872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.217537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.217823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.218102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.218922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:29.219235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.219778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.220677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.221259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.233039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 343/677] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:29.233824 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:29.235328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:29.236168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:29.237046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 335/678] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:29.237530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.260088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.285144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.335867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2784a5-a983-4a31-a11a-c32edd48f76b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.336150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fd11a-5683-4ab8-87bb-52cce2dc37c6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.369697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.370016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.370392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.370673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.370847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.370942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.371131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.371410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.371767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=efc3534120be42ce9bc7ebb6f2a8fbc5) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:29.372583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.374019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.380209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 344/679] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/role_assignments?user.id=efc3534120be42ce9bc7ebb6f2a8fbc5&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:29.381067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.397850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.400311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:29.422153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:29.423142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:29.429139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:29.429139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:29.429139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:29.429139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:29.429139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 336/680] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:29.429139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.525610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.527127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0801e-9f0c-4e4f-a91e-35237f7e9c48 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.548640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.573514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25cbc-6b99-4e38-8767-706581135874 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.575119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.575994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.576276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.576548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.592104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:29.600197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:29.601202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:29.602065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:29.606880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 345/681] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:29.608211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.619534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.620264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.620551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.620830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.621706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=dc579eaf4c3e4ea5a77063ba5f3d4b99) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:29.622144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.624579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.631799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 337/682] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/role_assignments?user.id=dc579eaf4c3e4ea5a77063ba5f3d4b99&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:29.632672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.749348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00ae6-3ec7-46b1-b12b-36959a8f18b1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.775560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52fabc-f962-477b-965f-6c4137395829 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.802568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.804034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.804334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.804619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.805823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:29.806139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.808684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.824433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:29.825148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:29.825414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:29.825728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:29.826512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:29.826830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:29.834211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 346/683] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:29.834211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.834594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:29.834594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.846752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 338/684] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:29.847629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:29.880213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:29.969603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96347a2-f098-486b-8f72-d8b6750e02c5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:29.985322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241af9ce-b867-45df-9d14-2ab2e686e0c2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.013627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.014899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.015433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.015793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.016626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:30.017028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.018502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.029478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 347/685] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:30.030489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.035172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.035920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.036266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.036662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.037530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=164a361891274af1b20fe7b7458ecde6) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:30.038199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.039588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.047807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 339/686] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:29 2022] GET /identity/v3/role_assignments?user.id=164a361891274af1b20fe7b7458ecde6&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:30.055510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.161544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:30.172582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a587-a7e1-4f6f-aaf1-bf6dd3ac473f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.217630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:30.224107 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.225320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.225790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.226272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.236489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.238067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:30.265119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:30.266128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:30.267140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:30.272689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 348/687] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:30.277588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.306749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25d349-44b4-4957-ae2a-e9cd4443fb6d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.354665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.355399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.355681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.355958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.369196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.370764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:30.393333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:30.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:30.395173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:30.395173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:30.395173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:30.395173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:30.395173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 340/688] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:30.402926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504f744-6f52-4e27-a8dd-55fbe05890d0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.403205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.443095 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.443817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.444099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.444371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.446204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:30.446204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.447637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.472191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 349/689] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:30.479467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.498884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:30.532640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fc90d-a613-44bd-b5c6-423e817155ad None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.548642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:30.573749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.574823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.575373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.576019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.577128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:30.577661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.579435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.597623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f288-ad69-4fa0-a6af-be81060aa1b8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.598062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 341/690] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:30.600343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.641024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.641268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.641350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.641650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.717168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753d778-875c-4f93-bc15-d06105b0bde9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.719746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.721361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.737348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:30.758466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.759957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.761397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.761955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.773002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.775116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:30.797467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:30.798603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:30.799513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:30.800035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 342/691] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:30.807217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.845298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:30.891772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 350/692] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:00:30.901394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:30.935859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df024-60ce-4117-88cd-30d575e3de1e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:30.977163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:30.978262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:30.978757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:30.979240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:30.980913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:30.982033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:30.983769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:31.007636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 343/693] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:31.013856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:31.123291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:31.130891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec89a-6f25-4b1a-b6df-5c23a6cfcdc0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:31.161262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd952ab-7178-4c97-a0f7-6dee33622098 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:31.170230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:31.171052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:31.171450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:31.171838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:31.204057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:31.255034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:31.256734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:31.275322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:31.276742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:31.277166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:31.278311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:31.296981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:31.298837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:31.324502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:31.326203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:31.327293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:31.327293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:31.327293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:31.327293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:31.329238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 351/694] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:31.335441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:31.442155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:31.464303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 344/695] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:00:31.473934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:31.534241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c315-04e5-4828-b1ee-c6dcbffb0df4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:31.585299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:31.586029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:31.586344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:31.586621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:31.587489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:31.587795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:31.589528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:31.605604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 352/696] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:31.612726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:31.663842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:31.672546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db6881-22ac-4212-9a9c-fd97071a53a5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:31.739956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:31.741259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:31.741860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:31.742472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:31.763864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:31.765349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:31.794912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:31.795905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:31.796843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:31.796843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:31.796843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:31.796843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:31.807989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 345/697] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:31.810672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:31.846051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeae253-e9d5-42eb-8fb6-f96456c4924d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:31.886119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:31.928359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:31.929548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:31.930052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:31.930574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:31.951172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:31.952825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:31.962619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce63de-cc2d-489a-bb9d-abb24c0b641b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:31.976086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:31.977096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:31.977988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 353/698] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:31.984715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.030627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79488d9-3051-477e-b62c-cbfe0274ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.031235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79488d9-3051-477e-b62c-cbfe0274ed43 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.031569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79488d9-3051-477e-b62c-cbfe0274ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.031850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79488d9-3051-477e-b62c-cbfe0274ed43 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.032590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79488d9-3051-477e-b62c-cbfe0274ed43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:32.032898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79488d9-3051-477e-b62c-cbfe0274ed43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.034368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79488d9-3051-477e-b62c-cbfe0274ed43 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.050206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 346/699] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:32.051622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97706389-45fc-486b-922a-e2244033f661 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.051907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97706389-45fc-486b-922a-e2244033f661 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.052235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97706389-45fc-486b-922a-e2244033f661 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.058271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 347/700] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:32.059476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97706389-45fc-486b-922a-e2244033f661 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.112648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:32.129554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775aa59-b64a-4567-a79b-a3793e664cfd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.175675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6cb42-1b75-4ea4-8177-0a8fef737b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.176345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6cb42-1b75-4ea4-8177-0a8fef737b44 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.176625 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6cb42-1b75-4ea4-8177-0a8fef737b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.176901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6cb42-1b75-4ea4-8177-0a8fef737b44 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.177701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6cb42-1b75-4ea4-8177-0a8fef737b44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:32.178007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6cb42-1b75-4ea4-8177-0a8fef737b44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.179555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6cb42-1b75-4ea4-8177-0a8fef737b44 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.181197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97706389-45fc-486b-922a-e2244033f661 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.184930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:32.193375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 354/701] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:32.194790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592189e-dd12-4557-bf95-a6fb5e1e8637 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.195085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592189e-dd12-4557-bf95-a6fb5e1e8637 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.195365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592189e-dd12-4557-bf95-a6fb5e1e8637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.216111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0592189e-dd12-4557-bf95-a6fb5e1e8637 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:32.217373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0592189e-dd12-4557-bf95-a6fb5e1e8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:32.231781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25692-8524-42b9-9a2e-06dee790b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.232586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25692-8524-42b9-9a2e-06dee790b94f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.232871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25692-8524-42b9-9a2e-06dee790b94f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.233341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25692-8524-42b9-9a2e-06dee790b94f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.240581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25692-8524-42b9-9a2e-06dee790b94f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.242032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25692-8524-42b9-9a2e-06dee790b94f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8ff25692-8524-42b9-9a2e-06dee790b94f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:32.261679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:32.263224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:32.264503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:32.268378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 348/702] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:32.269682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af471-a9e1-4839-b91f-bf90b1e947bc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.269968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af471-a9e1-4839-b91f-bf90b1e947bc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.270281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af471-a9e1-4839-b91f-bf90b1e947bc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.275658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 349/703] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:32.275658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af471-a9e1-4839-b91f-bf90b1e947bc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.300059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 355/704] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:32.300919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592189e-dd12-4557-bf95-a6fb5e1e8637 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.399768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:32.400650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af471-a9e1-4839-b91f-bf90b1e947bc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.425251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592189e-dd12-4557-bf95-a6fb5e1e8637 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.442404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bac03-cd80-4785-99ec-fac286c6e16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.444065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bac03-cd80-4785-99ec-fac286c6e16d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.444503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bac03-cd80-4785-99ec-fac286c6e16d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.444929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bac03-cd80-4785-99ec-fac286c6e16d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.445958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bac03-cd80-4785-99ec-fac286c6e16d None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=72498fa7138e4308affc50fa1b1a78fd) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:32.446449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bac03-cd80-4785-99ec-fac286c6e16d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.448796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bac03-cd80-4785-99ec-fac286c6e16d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.466203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 350/705] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:32 2022] GET /identity/v3/role_assignments?user.id=72498fa7138e4308affc50fa1b1a78fd&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:32.466203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b4d38-eb26-4601-a181-11e5e8c6e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.466203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b4d38-eb26-4601-a181-11e5e8c6e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.466203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b4d38-eb26-4601-a181-11e5e8c6e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.470718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.470718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.470718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.470718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.471142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:32.471303 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.482227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.487681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1d3b4d38-eb26-4601-a181-11e5e8c6e3d0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:32.488936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1d3b4d38-eb26-4601-a181-11e5e8c6e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:32.506327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 356/706] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:32.507386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.521943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:32.578279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 351/707] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:32.579294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b4d38-eb26-4601-a181-11e5e8c6e3d0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.682952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9883-a8c4-42a4-9cca-6a171e0979ed None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.712343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b4d38-eb26-4601-a181-11e5e8c6e3d0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.732123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.733559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.733559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.733559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.735956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.735956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.738774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:32.755780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:32.756821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:32.758073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 357/708] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jul 21 10:00:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:32.759147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.771441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.772173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.772462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.772744 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.773604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=6d604a09f0e04fd2ac41f31a4e13e166) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:32.773922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.775484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.783280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 352/709] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:32 2022] GET /identity/v3/role_assignments?user.id=6d604a09f0e04fd2ac41f31a4e13e166&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:32.784183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:32.810664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:32.924237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef6eca-46b6-4a81-9453-656440d8bc80 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.939422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559173-ec82-4248-aa6d-e2f11a279627 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:32.990827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.991648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.991926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.993537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] PATH_INFO: `/v3/services/network` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:32.993537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:32.994250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:32.998409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:32.999117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:32.999403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:32.999685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.000490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:33.000806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:33.002627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:33.010122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:33.011313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:33.013056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:33.014441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 353/710] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jul 21 10:00:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:33.014551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 358/711] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:32 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:33.020070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:33.020356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:33.108941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:33.120230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:33.143050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4fd57-6eee-4891-9070-f0dc7555acec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:33.159880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15aa2f-130c-42b0-8260-b2132131d086 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:33.192231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479497ea-279e-47cf-9197-29d45ca580da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:33.194137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479497ea-279e-47cf-9197-29d45ca580da None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:33.194853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479497ea-279e-47cf-9197-29d45ca580da None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:33.195409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479497ea-279e-47cf-9197-29d45ca580da None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.196970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479497ea-279e-47cf-9197-29d45ca580da None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:33.198143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479497ea-279e-47cf-9197-29d45ca580da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:33.200596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479497ea-279e-47cf-9197-29d45ca580da None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:33.204835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:33.205944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:33.206316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 354/712] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:00:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:33.207790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c9f3-c671-4cd4-9d7f-27a84acfe0cb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:33.208220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c9f3-c671-4cd4-9d7f-27a84acfe0cb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:33.208640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c9f3-c671-4cd4-9d7f-27a84acfe0cb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.210272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 355/713] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:33.210759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:33.211292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.212643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:33.213203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:33.215517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e3fae-f5af-4161-bc82-5e01bd50065e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:33.216496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e3fae-f5af-4161-bc82-5e01bd50065e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:33.216956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e3fae-f5af-4161-bc82-5e01bd50065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.218422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:33.226139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 359/714] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jul 21 10:00:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:33.230223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:33.251438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-033e3fae-f5af-4161-bc82-5e01bd50065e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:33.252634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-033e3fae-f5af-4161-bc82-5e01bd50065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:33.373014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ec77f-553c-4dfd-9c0c-9d2fb066fa4a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:33.404295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:33.418200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 356/715] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:00:33.423619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:33.424711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:33.425208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:33.425702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.426686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:33.427222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:33.428858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:33.435490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 360/716] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:00:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:33.449247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e3fae-f5af-4161-bc82-5e01bd50065e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:33.560561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:33.584457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e3fae-f5af-4161-bc82-5e01bd50065e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:33.626001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:33.626865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:33.627147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:33.627422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.645966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:33.647508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:33.671481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:33.672569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:33.673575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:33.673575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:33.673575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:33.673575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:33.673575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 357/717] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:33.679142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:33.790786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c126d8-2deb-4ed2-9599-d100fd5ad3e4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:33.838286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6c0a-2328-4f97-988c-9b995a093eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:33.839362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6c0a-2328-4f97-988c-9b995a093eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:33.840128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6c0a-2328-4f97-988c-9b995a093eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:33.841138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6c0a-2328-4f97-988c-9b995a093eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:33.842083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6c0a-2328-4f97-988c-9b995a093eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:33.842623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6c0a-2328-4f97-988c-9b995a093eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:33.844257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6c0a-2328-4f97-988c-9b995a093eb9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:33.858687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 361/718] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:33.863981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:34.049730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd12dd-42dd-4be9-b4d4-97fc65d2ccb9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:34.095024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:34.105144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d4175-d9be-4365-a681-c2d2d3361043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:34.105837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4175-d9be-4365-a681-c2d2d3361043 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:34.106147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4175-d9be-4365-a681-c2d2d3361043 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:34.106684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4175-d9be-4365-a681-c2d2d3361043 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:34.107992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d4175-d9be-4365-a681-c2d2d3361043 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:34.109930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d4175-d9be-4365-a681-c2d2d3361043 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:34.139818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 358/719] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:00:33 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:34.982449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae70b6-1058-46ae-8b19-1342e4ec3154 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:34.982990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae70b6-1058-46ae-8b19-1342e4ec3154 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:34.982990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae70b6-1058-46ae-8b19-1342e4ec3154 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:34.984758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 362/720] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:34.991491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efcec1-df76-44c0-bac3-8b95ac049619 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:34.991969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efcec1-df76-44c0-bac3-8b95ac049619 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:34.992046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efcec1-df76-44c0-bac3-8b95ac049619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:35.011959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d4efcec1-df76-44c0-bac3-8b95ac049619 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:35.013235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d4efcec1-df76-44c0-bac3-8b95ac049619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:35.113423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 359/721] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:35.149499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae70b6-1058-46ae-8b19-1342e4ec3154 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:35.202687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba4da9-67c3-48d4-b68c-76029af47622 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:35.203016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba4da9-67c3-48d4-b68c-76029af47622 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:35.203249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba4da9-67c3-48d4-b68c-76029af47622 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:35.204631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 360/722] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:35.210111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6965-1857-447f-892f-c0f3116f50cc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:35.210437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6965-1857-447f-892f-c0f3116f50cc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:35.210731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6965-1857-447f-892f-c0f3116f50cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:35.232867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:35.246652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8cff6965-1857-447f-892f-c0f3116f50cc None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:35.248278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8cff6965-1857-447f-892f-c0f3116f50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:35.347443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae70b6-1058-46ae-8b19-1342e4ec3154 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:35.383825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 361/723] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:00:35.408168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff6965-1857-447f-892f-c0f3116f50cc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:35.424784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:35.425998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:35.426514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:35.427000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:35.447959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:35.460602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:35.461590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:35.466268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:35.466969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:35.467053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 363/724] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:35.470636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:35.578244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff6965-1857-447f-892f-c0f3116f50cc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:35.678955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:35.680160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:35.680660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:35.681145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:35.694255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1f50-dc64-41e7-9b2d-aaafe8462bb3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:35.707184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:35.709071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:35.716490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:35.717784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:35.718858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:35.720705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 362/725] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:35.728631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:35.752717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:35.753622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:35.754031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:35.754488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:35.755461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:35.755912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:35.758089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:35.768609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 364/726] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:35.779411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:35.918103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4fc1c-a8a3-4eb6-a627-92ae3e0a1c35 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:35.926067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:35.971573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c48e61-f49b-4f2d-85e7-f6c668deaa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:35.972636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48e61-f49b-4f2d-85e7-f6c668deaa8e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:35.973154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48e61-f49b-4f2d-85e7-f6c668deaa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:35.973666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48e61-f49b-4f2d-85e7-f6c668deaa8e None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:35.974714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c48e61-f49b-4f2d-85e7-f6c668deaa8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:35.975241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c48e61-f49b-4f2d-85e7-f6c668deaa8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:35.976881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c48e61-f49b-4f2d-85e7-f6c668deaa8e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:35.987321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c1ab-2294-4a1e-9240-9bc917b727b3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:35.994519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 363/727] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:35.996573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb822960-224f-4898-b6ec-e9851117f3a3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:35.997603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb822960-224f-4898-b6ec-e9851117f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:35.998082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb822960-224f-4898-b6ec-e9851117f3a3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.003882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 364/728] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:36.005908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0f5f-a05f-446d-9e6d-c6e97ca9f69d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.006448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0f5f-a05f-446d-9e6d-c6e97ca9f69d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.006946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0f5f-a05f-446d-9e6d-c6e97ca9f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.025492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1cce0f5f-a05f-446d-9e6d-c6e97ca9f69d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:36.027137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1cce0f5f-a05f-446d-9e6d-c6e97ca9f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:36.034933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:36.035748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.036027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.036298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.052099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:36.053577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:36.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:36.077191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:36.078602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:36.078602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:36.078602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:36.078602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:36.078602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 365/729] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:36.080013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.110925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:36.117635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 365/730] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:36.119620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7ccb-4e93-4441-8344-e537a921e4dc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.120046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7ccb-4e93-4441-8344-e537a921e4dc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.120528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7ccb-4e93-4441-8344-e537a921e4dc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.122998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 366/731] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:36.124631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7ccb-4e93-4441-8344-e537a921e4dc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.199137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a177-d4f0-44f7-a7ed-a34b8019a4b4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.239732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5f010-7966-4d57-8e83-e275f05bc2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:36.240665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f010-7966-4d57-8e83-e275f05bc2ad None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.240950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f010-7966-4d57-8e83-e275f05bc2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.241231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f010-7966-4d57-8e83-e275f05bc2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.253741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5f010-7966-4d57-8e83-e275f05bc2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:36.255285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5f010-7966-4d57-8e83-e275f05bc2ad None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:36.263462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:36.269425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7ccb-4e93-4441-8344-e537a921e4dc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-39d5f010-7966-4d57-8e83-e275f05bc2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:36.274663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:36.275564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:36.276499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:36.276499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:36.276499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:36.276499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:36.280767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 366/732] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:36.282148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38545a8c-f708-4e7c-a656-bb5fd338f44a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.282458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38545a8c-f708-4e7c-a656-bb5fd338f44a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.282734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38545a8c-f708-4e7c-a656-bb5fd338f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.301104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-38545a8c-f708-4e7c-a656-bb5fd338f44a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:36.302365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-38545a8c-f708-4e7c-a656-bb5fd338f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:36.306704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:36.307391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.307657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.307979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.308773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:36.309081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:36.311159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:36.324499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 367/733] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:36.325860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.388221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 367/734] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:00:36.395362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38545a8c-f708-4e7c-a656-bb5fd338f44a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.409768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:36.443865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10db047-ad09-49eb-90c7-640147511792 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.484508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:36.485194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.485838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.485838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.486526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:36.487900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:36.507433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 368/735] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:00:36 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:36.508648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.545076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:36.548038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38545a8c-f708-4e7c-a656-bb5fd338f44a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.602637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:36.603339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.603629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.603904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.604660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:36.604975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:36.607058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:36.620457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 368/736] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:36.621443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.651915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c45b1-3aa5-4a6c-a382-b9bc2bafd18c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.698386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:36.705027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:36.706563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.707021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.707536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.717802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:36.719371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:36.739832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:36.741062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 369/737] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:36.742318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.762973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b80ef-e035-46bc-95ca-44c44a9c98cb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.815074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:36.815912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:36.816328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:36.816793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:36.817652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:36.819710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:36.841222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 369/738] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:00:36 2022] POST /identity/v3/services => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:36.842164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:36.872936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:36.932655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a730-1f04-4187-b6b2-c0abc5b81983 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.968981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df660a36-1fe5-434f-9756-da16f0f1c8c0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:36.991948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:37.010389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.011086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.011366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.011636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.013182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:37.013441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:37.014955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:37.019386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646f503-3edc-4172-84bf-e253b5656ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.020229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646f503-3edc-4172-84bf-e253b5656ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.020520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646f503-3edc-4172-84bf-e253b5656ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.020809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646f503-3edc-4172-84bf-e253b5656ba9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.036271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 370/739] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jul 21 10:00:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:37.042044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646f503-3edc-4172-84bf-e253b5656ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:37.043071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.043616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646f503-3edc-4172-84bf-e253b5656ba9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6646f503-3edc-4172-84bf-e253b5656ba9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:37.060569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:37.061685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 370/740] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:00:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:37.063738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3404e-8611-4cae-8fa2-5fa923a5e507 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.064391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3404e-8611-4cae-8fa2-5fa923a5e507 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.064391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3404e-8611-4cae-8fa2-5fa923a5e507 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.071793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 371/741] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:37.073048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3404e-8611-4cae-8fa2-5fa923a5e507 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.225488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f0199-8e6b-4e9c-9253-5eafece639d5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:37.235322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3404e-8611-4cae-8fa2-5fa923a5e507 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:37.272783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.273648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.273930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.274228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.286830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a67d-900e-41d0-a58e-5f9a49e3d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.287607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a67d-900e-41d0-a58e-5f9a49e3d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.287897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a67d-900e-41d0-a58e-5f9a49e3d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.288600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a67d-900e-41d0-a58e-5f9a49e3d7ee None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.289482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a67d-900e-41d0-a58e-5f9a49e3d7ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:37.290135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a67d-900e-41d0-a58e-5f9a49e3d7ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:37.291971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a67d-900e-41d0-a58e-5f9a49e3d7ee None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:37.303170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:37.319858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 372/742] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:37.321458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3b9c-3a48-4451-a7f0-4e56d7eaf2d3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.321980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3b9c-3a48-4451-a7f0-4e56d7eaf2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.322441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3b9c-3a48-4451-a7f0-4e56d7eaf2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.334600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:37.345120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8ecd3b9c-3a48-4451-a7f0-4e56d7eaf2d3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:37.346935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ecd3b9c-3a48-4451-a7f0-4e56d7eaf2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:37.366475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:37.368623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:37.450979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 373/743] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:37.452171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd3b9c-3a48-4451-a7f0-4e56d7eaf2d3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.525028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 371/744] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:00:37.525912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.606388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd3b9c-3a48-4451-a7f0-4e56d7eaf2d3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:37.618955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:37.644629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:37.650037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.650987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26316-c88b-4ada-ab24-8543324c1dd6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:37.651288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.651574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.651850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.663622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:37.665367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:37.685255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:37.686251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:37.687112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:37.687112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:37.687112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:37.687112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:37.694215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 374/745] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:37.694215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.699239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.700863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.701346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.701805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.717018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:37.729041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:37.730032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:37.730882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:37.742314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 372/746] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:37.742314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.823403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e81-3361-4e2b-8311-109913dabe30 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:37.866967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.867858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.868505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.868790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.888559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:37.890359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:37.895650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42ed15-53b6-4059-a213-dc0ac0fde57a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:37.917908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:37.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:37.919993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:37.919993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:37.919993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:37.919993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:37.919993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 375/747] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:37.921030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.937419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:37.938491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:37.938875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:37.939252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:37.940152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:37.940559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:37.942147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:37.945010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:37.957798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 373/748] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:37.959260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:37.962635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:38.061594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda07be-aab7-49fc-825d-b6ba1b36d21c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.090360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177b9e0-1f97-43e7-be04-7dcfdc6f2331 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.100799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.101873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.102539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.103046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.104040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:38.104551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.106277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.115813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 376/749] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:38.117084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.132734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.133824 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.134350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.134891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.135844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:38.136357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.138691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.151885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 374/750] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:38.153216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.237636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:38.241466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:38.250004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69339b73-6a45-42f8-ba35-3d797179c69b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.296473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.298020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.298738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.299540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.304426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2233eb-5a32-4de6-abec-772a58422589 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.308707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.310489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:38.326414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:38.327354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:38.328249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:38.335417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 377/751] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:38.336584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.342777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.343533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.343816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.344091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.358564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.360652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:38.387799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:38.388745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:38.389770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:38.389770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:38.389770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:38.389770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:38.397100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 375/752] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:38.398482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.475350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130f68-c972-415c-8a62-1869636adc9c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.530875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.532167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.532659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.533136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.541487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.543556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.547624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9e4d1-e57d-4e92-9575-08ec09eba331 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.560496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:38.561535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:38.562448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:38.563318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:38.566615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 378/753] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:38.568008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.586634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:38.599577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.600313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.600618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.600898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.602043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:38.602393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.604135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.629808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 376/754] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:38.629808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.700344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667e07-591b-4127-9991-ab80f00b601d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.739046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab567c-9645-413a-94b2-8ea0abc1e7f1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.740742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.741819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.742422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.742905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.743876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:38.744388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.745986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.767103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 379/755] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:38.768309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.778894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.780087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.780087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.780413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.781821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:38.782414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.785089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.805817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 377/756] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:38.811591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.848624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:38.857186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:38.893373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587d863-ab70-4c62-81d8-7bf97ce90fec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.929406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275a581-5897-4254-9366-bf724a4c6f21 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:38.936373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.938413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.938919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.939442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/6d604a09f0e04fd2ac41f31a4e13e166/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.943099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=6d604a09f0e04fd2ac41f31a4e13e166, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.945615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:38.964329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 380/757] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:38 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/6d604a09f0e04fd2ac41f31a4e13e166/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:38.965734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:38.968431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de339b-49ad-4b1a-af36-9a7e4f8f3cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:38.969933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de339b-49ad-4b1a-af36-9a7e4f8f3cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:38.970439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de339b-49ad-4b1a-af36-9a7e4f8f3cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:38.971967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de339b-49ad-4b1a-af36-9a7e4f8f3cc4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:38.984054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de339b-49ad-4b1a-af36-9a7e4f8f3cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:38.986470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de339b-49ad-4b1a-af36-9a7e4f8f3cc4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-53de339b-49ad-4b1a-af36-9a7e4f8f3cc4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:39.007927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:39.009808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 378/758] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ad77-9a5b-4bd9-8ca3-a06ccfce73a5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.017532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ad77-9a5b-4bd9-8ca3-a06ccfce73a5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.018882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ad77-9a5b-4bd9-8ca3-a06ccfce73a5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.021946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 379/759] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:39.023832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67745b0f-0a8b-4955-8afa-5fe533e98dc8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.024234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67745b0f-0a8b-4955-8afa-5fe533e98dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.024640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67745b0f-0a8b-4955-8afa-5fe533e98dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.050377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-67745b0f-0a8b-4955-8afa-5fe533e98dc8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:39.051818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67745b0f-0a8b-4955-8afa-5fe533e98dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:39.146850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260596d-59c9-4e28-8bad-6c4c0e616883 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:39.155833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 380/760] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:39.156934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67745b0f-0a8b-4955-8afa-5fe533e98dc8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.183637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:39.195993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:39.206526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:39.207658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.207972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.208255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.209116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=72498fa7138e4308affc50fa1b1a78fd) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:39.209435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:39.210947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.220435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 381/761] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:38 2022] GET /identity/v3/role_assignments?user.id=72498fa7138e4308affc50fa1b1a78fd&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:39.221314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.295936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67745b0f-0a8b-4955-8afa-5fe533e98dc8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:39.333411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f9f28-12ae-44fa-826a-a81adbd0443b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:39.338457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e572b-9e64-40eb-b9d2-568c4c544925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:39.339577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e572b-9e64-40eb-b9d2-568c4c544925 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.340307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e572b-9e64-40eb-b9d2-568c4c544925 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.341369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e572b-9e64-40eb-b9d2-568c4c544925 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.342593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e572b-9e64-40eb-b9d2-568c4c544925 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:39.343113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e572b-9e64-40eb-b9d2-568c4c544925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:39.345032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e572b-9e64-40eb-b9d2-568c4c544925 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.367207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 381/762] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:39.369146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ecd49-a9d0-4642-9cb1-25b9724352dc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.369664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ecd49-a9d0-4642-9cb1-25b9724352dc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.370137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ecd49-a9d0-4642-9cb1-25b9724352dc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.372207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 382/763] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:39.375033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ecd49-a9d0-4642-9cb1-25b9724352dc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.377577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cea952-fe01-4650-8b69-f6f5ed97cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:39.378463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cea952-fe01-4650-8b69-f6f5ed97cb56 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.378752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cea952-fe01-4650-8b69-f6f5ed97cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.379035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cea952-fe01-4650-8b69-f6f5ed97cb56 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.379728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cea952-fe01-4650-8b69-f6f5ed97cb56 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:39.381678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cea952-fe01-4650-8b69-f6f5ed97cb56 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e2cea952-fe01-4650-8b69-f6f5ed97cb56 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:39.397374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:39.398512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:39.399320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:39.404383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 382/764] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:39.405926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813419e1-89d8-4a59-b894-3482139951e5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.406317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813419e1-89d8-4a59-b894-3482139951e5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.406607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813419e1-89d8-4a59-b894-3482139951e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.424960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-813419e1-89d8-4a59-b894-3482139951e5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:39.426199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-813419e1-89d8-4a59-b894-3482139951e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:39.498112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:39.498352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:39.509990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ecd49-a9d0-4642-9cb1-25b9724352dc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:39.511655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 383/765] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:39.513381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813419e1-89d8-4a59-b894-3482139951e5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.564039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:39.564631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.564916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.565190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.620478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813419e1-89d8-4a59-b894-3482139951e5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:39.646016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:39.647707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.658315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:39.659380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.659867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.660350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.661272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:39.661782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:39.663420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.668611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 384/766] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:39.670316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.742740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:39.752734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:39.794737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 383/767] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:00:39.794737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.806764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e0d3-4fa1-413c-9b71-2bf3c7f906a4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:39.853951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:39.855166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.855651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.856784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] PATH_INFO: `/v3/services/network` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.857661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:39.859301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:39.873098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:39.874241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:39.875064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:39.878158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 385/768] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:39.879414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.911174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d272e-db99-447d-b22f-deac6c0bb3d5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:39.947769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:39.948467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:39.948815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:39.949015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:39.949761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:39.950074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:39.951959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:39.957821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 384/769] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:39.958769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:39.998854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2a302-51c4-4e6d-bcfa-60d696e6be4a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.019952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:40.037310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:40.042630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.043740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.044118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.044404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.056859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.058377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:40.077309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:40.078296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:40.079163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:40.079163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:40.079163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:40.079163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:40.083405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 386/770] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:40.084357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.120919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5fc3c-8acd-4df4-93dd-37a412a7ba88 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.172239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.174225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.174997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.175461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.176393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] RBAC: Adding query filter params (name=network) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:40.176892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.178710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.186280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 385/771] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:00:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:40.187532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.222639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8715d-e271-4fd4-9470-9573f2f5b40a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.266819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.267822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.268157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.268533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.269454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] RBAC: Adding query filter params (interface=public, service_id=2424bd4432cd4be1bb8e2ea97995df89, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:40.269866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.271733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.285249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 387/772] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/endpoints?service_id=2424bd4432cd4be1bb8e2ea97995df89&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:40.286295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.317752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795535b-5072-438f-a15d-31c555ad1b97 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.321302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:40.333281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:40.365729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.366859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.367341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.367808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.368748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:40.369250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.370867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.391894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 386/773] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:40.393324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.417969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5405f-9a27-4b3a-8b8a-8af0c908544b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.460804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.461844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.462371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.462851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.464117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] RBAC: Adding query filter params (type=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:40.464452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.466214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.481299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 388/774] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:40.482373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.534937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18053-de2c-473f-8469-66fca448a08a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.587567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.588965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.589462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.590139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.591061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.593541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.601939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 387/775] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:40.603636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.630242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:40.631813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b9afd-bd45-4a67-8b1c-7d0b8a390492 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.679758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.680607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.680896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.681181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.690384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:40.701832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.703371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:40.732372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:40.733962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:40.735524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 389/776] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:40.749178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.822966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0ed69-3b8f-4795-8db5-bbe9d620900a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:40.870341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:40.871028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:40.871314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:40.871659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:40.872973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] RBAC: Adding query filter params (interface=public, service_id=c72b65637a2b4d9cbc6fc36e28103250, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:40.873289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:40.874935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:40.884222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 388/777] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/endpoints?service_id=c72b65637a2b4d9cbc6fc36e28103250&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:40.890080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:40.964232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb206b-027b-46b1-8816-d078e8bd7880 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:41.030675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:41.045899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:41.046619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.046907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.047190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.048192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:41.048508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:41.050129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:41.051944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b28e7-c07e-43f6-9736-749177ab61d2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:41.067614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 390/778] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:41.070811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:41.112195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:41.124369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4090d-4c55-40d2-b9a2-c584ca164bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:41.125068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4090d-4c55-40d2-b9a2-c584ca164bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.125356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4090d-4c55-40d2-b9a2-c584ca164bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.125637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4090d-4c55-40d2-b9a2-c584ca164bf8 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.126370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4090d-4c55-40d2-b9a2-c584ca164bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:41.127767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4090d-4c55-40d2-b9a2-c584ca164bf8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:41.149252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 389/779] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:00:40 2022] GET /identity/v3/services => generated 772 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:41.262944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064f778-9af0-44f7-9fad-26b9d31493cd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:41.323156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ce0d2-2980-4040-84f8-d6c4026354b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:41.323844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce0d2-2980-4040-84f8-d6c4026354b5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.324127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce0d2-2980-4040-84f8-d6c4026354b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.324402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce0d2-2980-4040-84f8-d6c4026354b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.325318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ce0d2-2980-4040-84f8-d6c4026354b5 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=91369e2de7944f68acbaff6d5f8c28ef) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:41.325633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ce0d2-2980-4040-84f8-d6c4026354b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:41.327152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ce0d2-2980-4040-84f8-d6c4026354b5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:41.339134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 391/780] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:41 2022] GET /identity/v3/role_assignments?user.id=91369e2de7944f68acbaff6d5f8c28ef&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:41.364589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0823bd-a5a3-45ee-9b48-bbfaac2f0361 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.365113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0823bd-a5a3-45ee-9b48-bbfaac2f0361 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.365190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0823bd-a5a3-45ee-9b48-bbfaac2f0361 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.368430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 390/781] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:41.374494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18eecd-4946-42a6-9798-c621615a169f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.375173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18eecd-4946-42a6-9798-c621615a169f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.375661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18eecd-4946-42a6-9798-c621615a169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.399200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3c18eecd-4946-42a6-9798-c621615a169f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:41.400469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c18eecd-4946-42a6-9798-c621615a169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:41.497755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 392/782] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:41.517432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0823bd-a5a3-45ee-9b48-bbfaac2f0361 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:41.560522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9d44-a789-48f6-8f71-9b6711b8919d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.560881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9d44-a789-48f6-8f71-9b6711b8919d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.561090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9d44-a789-48f6-8f71-9b6711b8919d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.562888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 393/783] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:41.578297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c163-6a42-443d-a7ad-56ec11fccb4a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.578297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c163-6a42-443d-a7ad-56ec11fccb4a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.578549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c163-6a42-443d-a7ad-56ec11fccb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.610445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-35f8c163-6a42-443d-a7ad-56ec11fccb4a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:41.611674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-35f8c163-6a42-443d-a7ad-56ec11fccb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:41.631759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:41.715152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0823bd-a5a3-45ee-9b48-bbfaac2f0361 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:41.728236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 394/784] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:41.763716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c163-6a42-443d-a7ad-56ec11fccb4a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:41.776153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:41.776970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:41.777255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:41.778923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:41.799698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:41.813207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:41.814290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:41.815174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:41.817818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 391/785] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:41.824390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:41.860698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:41.975247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c163-6a42-443d-a7ad-56ec11fccb4a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:42.014860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:42.015673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:42.015961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:42.016240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:42.027590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:42.028455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e7453-4c0b-4097-b21d-d1bd287424f1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:42.041007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:42.042569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:42.043643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:42.044472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 395/786] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:42.051508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:42.065657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:42.124454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:42.125065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:42.125404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:42.125683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:42.126542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:42.126855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:42.128328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:42.152418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 392/787] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:42.166655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:42.244968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964fdaf-ba1f-4976-9345-9e4e2597c132 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:42.337002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:42.341758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:42.342484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:42.342769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:42.343045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:42.343807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:42.344114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:42.345493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:42.361427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 396/788] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:42.365436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d26b6f-2f2a-49bc-abd0-a8c14a2e702b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:42.366937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:42.409580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:42.410759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:42.411277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:42.411797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:42.439787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:42.441235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:42.477945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:42.478840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:42.480242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:42.481782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:42.481782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:42.481782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:42.481782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:42.481782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 393/789] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:42.495360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:42.522399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d793b25-056e-48d7-9101-fce09ccfd19f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:42.561845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:42.562677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:42.562960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:42.563235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:42.583010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:42.584491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:42.616422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:42.617510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:42.618486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:42.618486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:42.618486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:42.618486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:42.618486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 397/790] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:42.624591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:42.709155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b56bd-b4ee-4aa2-9d1c-006f5c071740 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:42.786400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:42.797140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:42.798928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:42.799208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:42.801286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:42.802090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:42.802433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:42.803891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:42.823664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 394/791] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:42.826734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6dda5-6ab5-46d7-8b48-17343256f947 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:42.829961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:42.845530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:42.866817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:42.867914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:42.868453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:42.868937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:42.869910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:42.870459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:42.872631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:42.886088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 398/792] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:42.892638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:43.059929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f0433-ca48-405d-8db0-0046d94b33c1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:43.088631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eacb27-fdcb-45ac-9835-c5c265d314e4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:43.127952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:43.129136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.129709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.130218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.139405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:43.141228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:43.147933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b791d-a471-4ac5-b4d8-ee27cb53248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:43.148768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b791d-a471-4ac5-b4d8-ee27cb53248c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.149050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b791d-a471-4ac5-b4d8-ee27cb53248c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.149322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b791d-a471-4ac5-b4d8-ee27cb53248c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:43.158669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:43.159643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:43.160570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:43.163931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 399/793] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:43.170902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:43.175903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b791d-a471-4ac5-b4d8-ee27cb53248c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:43.176647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b791d-a471-4ac5-b4d8-ee27cb53248c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-fb3b791d-a471-4ac5-b4d8-ee27cb53248c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:43.197267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:43.198328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:43.199227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 395/794] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:00:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:43.200374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1939003-deb3-4df8-bee8-307042b30b0d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.200611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1939003-deb3-4df8-bee8-307042b30b0d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.200882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1939003-deb3-4df8-bee8-307042b30b0d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.206360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 396/795] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:43.207274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1939003-deb3-4df8-bee8-307042b30b0d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:43.224720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:43.269948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:43.324271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f36d7-3818-4b6b-956a-d77b1348ebc7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:43.336335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1939003-deb3-4df8-bee8-307042b30b0d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:43.375385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a201c7-4cbb-45b9-aa1b-13db738e2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:43.376542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a201c7-4cbb-45b9-aa1b-13db738e2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.376857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a201c7-4cbb-45b9-aa1b-13db738e2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.377132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a201c7-4cbb-45b9-aa1b-13db738e2cd7 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.377991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a201c7-4cbb-45b9-aa1b-13db738e2cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:43.378332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a201c7-4cbb-45b9-aa1b-13db738e2cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:43.379178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:43.379835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a201c7-4cbb-45b9-aa1b-13db738e2cd7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:43.380632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.381117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.381947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.384169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:43.384741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:43.386432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:43.407615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 397/796] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:43.414061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb190b-c8b5-4802-b2d2-5597e68e7fe7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.414061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb190b-c8b5-4802-b2d2-5597e68e7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.414061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb190b-c8b5-4802-b2d2-5597e68e7fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.414593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 400/797] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jul 21 10:00:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:43.415806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:43.432670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f8fb190b-c8b5-4802-b2d2-5597e68e7fe7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:43.433800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f8fb190b-c8b5-4802-b2d2-5597e68e7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:43.522328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 398/798] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:43.523604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb190b-c8b5-4802-b2d2-5597e68e7fe7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:43.533502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:43.542578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73817-f228-428a-8ef0-be163b1872fc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:43.582764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedebccb-96ad-4425-92ac-00817ee9d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:43.584083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:43.584706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebccb-96ad-4425-92ac-00817ee9d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.585334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebccb-96ad-4425-92ac-00817ee9d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.585898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebccb-96ad-4425-92ac-00817ee9d2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.657422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb190b-c8b5-4802-b2d2-5597e68e7fe7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:43.699691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:43.700617 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.700900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.701175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.713450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:43.715741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:43.736209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:43.737179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:43.738137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:43.738137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:43.738137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:43.738137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:43.742417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 399/799] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:43.743382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:43.801078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedebccb-96ad-4425-92ac-00817ee9d2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:43.802939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedebccb-96ad-4425-92ac-00817ee9d2a9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:43.841819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:43.853024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641d84-eacc-4d0d-8987-8e5bccfe92a7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:43.893023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:43.893967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.894290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.894564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.895233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:43.896631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:43.909349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:43.910633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:00:43.911600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:43.912764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 400/800] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jul 21 10:00:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:43.914072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:43.914764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:43.932330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 401/801] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:00:43.933599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0318e-64b9-4b6d-b0d1-3f81a3435338 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.933817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0318e-64b9-4b6d-b0d1-3f81a3435338 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.934662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0318e-64b9-4b6d-b0d1-3f81a3435338 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.936186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 402/802] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:43.938816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302cabb-6b51-4495-bba0-86d2ac79dce6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:43.939160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302cabb-6b51-4495-bba0-86d2ac79dce6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:43.939470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302cabb-6b51-4495-bba0-86d2ac79dce6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:43.940796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 403/803] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:43.941521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302cabb-6b51-4495-bba0-86d2ac79dce6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.045451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c813b95-96c8-4abb-8ece-825260664e6e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.051169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302cabb-6b51-4495-bba0-86d2ac79dce6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.081930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57c09-c839-49f2-b45a-dc6835c1295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.082638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57c09-c839-49f2-b45a-dc6835c1295d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.082928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57c09-c839-49f2-b45a-dc6835c1295d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.083207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57c09-c839-49f2-b45a-dc6835c1295d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.083944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57c09-c839-49f2-b45a-dc6835c1295d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:44.084253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57c09-c839-49f2-b45a-dc6835c1295d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.085657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57c09-c839-49f2-b45a-dc6835c1295d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.090293 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.090971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.091251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.091524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.092296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:44.092540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.094465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.098747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 404/804] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jul 21 10:00:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:44.105390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 401/805] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:44.105583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.105684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9465d-64cf-496c-88d7-5f1d7dd71030 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.105684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9465d-64cf-496c-88d7-5f1d7dd71030 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.105684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9465d-64cf-496c-88d7-5f1d7dd71030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.118417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1fc9465d-64cf-496c-88d7-5f1d7dd71030 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:44.119644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1fc9465d-64cf-496c-88d7-5f1d7dd71030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:44.131510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.172993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.191014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 402/806] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:44.192426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40689d9-1e18-4edb-b355-c432d43f1463 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.192713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40689d9-1e18-4edb-b355-c432d43f1463 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.192996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40689d9-1e18-4edb-b355-c432d43f1463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.216232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f40689d9-1e18-4edb-b355-c432d43f1463 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:44.218016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f40689d9-1e18-4edb-b355-c432d43f1463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:44.231490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e03826-457b-4499-bba8-0fa95507686a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.269669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.270623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.270900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.271177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.284909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.286489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.308555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 403/807] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:44.309635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40689d9-1e18-4edb-b355-c432d43f1463 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:44.311154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:44.312629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:44.313675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:44.313675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:44.313675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:44.313675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:44.313675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 405/808] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:44.313675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.398728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.427634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40689d9-1e18-4edb-b355-c432d43f1463 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.439504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ead5e-b967-4d67-8594-7b7b6e8c1a3a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.450560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.462386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.463061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.463340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.463611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.464326 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:44.464631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.466826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.472381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 404/809] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:44.473221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.482703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.483516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.483802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.484080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.493312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.494870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:44.510251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:44.511198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:44.512575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:44.513154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 406/810] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:44.514133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.582151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82505-e794-4187-a8e1-407eec6f3cd2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.622071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.622903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.623216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.623621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] PATH_INFO: `/v3/services/network` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.624212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.625740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.629105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90287-c278-4129-98bc-5c6c41f22f5a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:44.641012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:44.642059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:44.642952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 405/811] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:44.644005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.646859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.673034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.673655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.673975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.674285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.675134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:44.675485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.677171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.694888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 407/812] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:44.695779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.734613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.763819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afafc83-5968-4be8-821f-f5a1d5ffe261 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.797837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.798684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.798972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.799243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.808054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a5d36-8d0b-4f46-8ec7-852e6a54a7f5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.809901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:44.817864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:44.819070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:44.819877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 406/813] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:44.820550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.848162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.848831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.849115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.849396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.850150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.851540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:44.876297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 408/814] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:00:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:44.876998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:44.891572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.940947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2e8c-62fe-48b6-9aee-f637c4116786 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:44.989633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:44.990181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:44.990518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:44.990647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:44.990914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:44.991718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:44.992023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:44.993498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.011292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 407/815] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:45.011945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.019468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b79e6-d6a4-4626-b2f1-0668859d764c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.065430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.066261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.066613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.066961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.067788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:45.068580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.070756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.077877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 409/816] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:00:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:45.078676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.146293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3f133-7717-4b44-9db9-07f6000ce972 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.167858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:45.192944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.193673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.193965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.194270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.204841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.206353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.217049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a062-b94b-41b0-a1c6-666abc7f0ba0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:45.221333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:45.222475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:45.223376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:45.227355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 408/817] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:45.228265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.257977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.258714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.259014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.259298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.260071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:45.260382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.261781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.274649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 410/818] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:45.275992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.297912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:45.353621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ef7e1-157a-469d-b1be-963216867e80 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.390779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.391688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.391971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.392266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/72498fa7138e4308affc50fa1b1a78fd/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.396597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=72498fa7138e4308affc50fa1b1a78fd, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.398252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.405842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07889217-3b50-43c4-b3e4-47308e538110 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.414817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 409/819] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:45 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/72498fa7138e4308affc50fa1b1a78fd/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:45.416000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.465684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.466926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.468084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.468574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.469589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] RBAC: Adding query filter params (type=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:45.469906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.475584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.480701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:45.487957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 411/820] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:00:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:45.487957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.587281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731bb50-c167-48a8-8a7d-97b1e62bc239 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.598108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:45.635823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae14c0c-9feb-426c-b0d7-aafdc7fb3559 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.643175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.644228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.644716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.645876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.647060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:45.647597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.650177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.667831 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 410/821] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:45.674536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.689021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.690278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.690831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.691322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.703330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.705151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:45.724651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:45.726881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:45.726881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:45.726881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:45.726881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:45.728872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 412/822] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:45.734794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.781615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:45.786589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fce38-2d6b-4b28-9af8-6b3f60e8aab2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.827708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.828394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.828681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.828964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.829954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.831449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.848629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8e4a-84bd-4713-a2e3-9fbaa74a62ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:45.862396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 411/823] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:00:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:45.863419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:45.880991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:45.921832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:45.923035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:45.923565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:45.924073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:45.925209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=6d604a09f0e04fd2ac41f31a4e13e166) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:45.925742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:45.927580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:45.935238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 413/824] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:45 2022] GET /identity/v3/role_assignments?user.id=6d604a09f0e04fd2ac41f31a4e13e166&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:46.004483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd15db-7bc8-4b73-9207-1519eb114c68 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:46.049756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:46.050490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:46.050826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:46.051109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:46.051872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:46.052185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:46.053624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:46.070479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 412/825] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:46.076770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:46.233984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb9ab-dc5c-40f1-a463-279caa0ac234 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:46.288896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:46.290264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:46.290707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:46.291121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:46.300200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:46.301670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:46.317623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:46.318670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:46.319594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 414/826] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:00:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:46.327474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:46.354499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:46.457495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64066632-966b-47d2-8576-d96b0a174ec2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:46.499757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:46.500737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:46.501220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:46.501692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:46.502835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:46.503364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:46.505095 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:46.525821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 413/827] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jul 21 10:00:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:46.531885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:46.586867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:46.643903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6182f-8aec-4ca7-a7c0-c9bcfba1ac50 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:46.680471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:46.681694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:46.682220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:46.682703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:46.695493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:46.697328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:46.717169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:46.718127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:46.719054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:46.719054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:46.719054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:46.719054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:46.721404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 415/828] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:46.727234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:46.823642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:46.863101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d677-3393-4318-8499-4829bccf1a1d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:46.900803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:46.901477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:46.901757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:46.902031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:46.902838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:46.903146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:46.904525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:46.917358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 414/829] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:46.923543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:47.031821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:47.034755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceba25-e3db-4d9f-8e2d-0c6b92042b44 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:47.071337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc0acf-7b1a-4e92-8a28-387695722054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:47.072146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0acf-7b1a-4e92-8a28-387695722054 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.072430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0acf-7b1a-4e92-8a28-387695722054 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.072708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0acf-7b1a-4e92-8a28-387695722054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.081295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc0acf-7b1a-4e92-8a28-387695722054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:47.082860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc0acf-7b1a-4e92-8a28-387695722054 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-92fc0acf-7b1a-4e92-8a28-387695722054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:47.098910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:47.099940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:47.100930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 416/830] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:47.106974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:47.132725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2acc-14dc-427d-9849-61f4349dcc9c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.133066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2acc-14dc-427d-9849-61f4349dcc9c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.133352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2acc-14dc-427d-9849-61f4349dcc9c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.135417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 417/831] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:47.144494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ace21-e215-42d6-8a28-4bd3d8225501 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.144821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ace21-e215-42d6-8a28-4bd3d8225501 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.145054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ace21-e215-42d6-8a28-4bd3d8225501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.172729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-807ace21-e215-42d6-8a28-4bd3d8225501 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:47.172729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-807ace21-e215-42d6-8a28-4bd3d8225501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:47.265565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886376d6-d225-4fd6-a345-c28f58092c65 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:47.282277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 418/832] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:00:47.297181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:47.303832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ace21-e215-42d6-8a28-4bd3d8225501 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:47.304220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:47.304968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.305244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.305576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.306470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:47.306782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:47.308299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:47.325190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 415/833] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:47.331287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:47.437446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:47.449620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ace21-e215-42d6-8a28-4bd3d8225501 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:47.466555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd96d7b-03c7-41fc-8119-88c99f652304 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:47.503103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:47.504120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.504567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.504985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.505792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:47.507396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:47.512716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:47.513723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.514105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.514523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/91369e2de7944f68acbaff6d5f8c28ef/roles/8bbb1d5f1b1047ffa69f7573478e9e6e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:47.524957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:47.526453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:47.528521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:47.531691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=91369e2de7944f68acbaff6d5f8c28ef, role_id=8bbb1d5f1b1047ffa69f7573478e9e6e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:47.533170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 419/834] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:47.537927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:47.539414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:47.563069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 416/835] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:00:47 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/91369e2de7944f68acbaff6d5f8c28ef/roles/8bbb1d5f1b1047ffa69f7573478e9e6e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:00:47.662933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954dff3-67cb-471b-8081-dd54f0de7835 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:47.702040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368955f-6feb-49a6-ad3c-0ddabba9524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:47.702678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368955f-6feb-49a6-ad3c-0ddabba9524b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.702966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368955f-6feb-49a6-ad3c-0ddabba9524b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.703248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368955f-6feb-49a6-ad3c-0ddabba9524b None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.703982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368955f-6feb-49a6-ad3c-0ddabba9524b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:47.704294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368955f-6feb-49a6-ad3c-0ddabba9524b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:47.705714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368955f-6feb-49a6-ad3c-0ddabba9524b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:47.711556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 420/836] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:47.719329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:47.742109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91b6a5-f38f-477a-ad2d-736c92e9c638 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.742501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91b6a5-f38f-477a-ad2d-736c92e9c638 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.742696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91b6a5-f38f-477a-ad2d-736c92e9c638 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.745853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 421/837] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:47.751409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1c56-a8db-41d2-9bb8-69cade5a36eb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.751700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1c56-a8db-41d2-9bb8-69cade5a36eb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.751978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1c56-a8db-41d2-9bb8-69cade5a36eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.773498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-17cd1c56-a8db-41d2-9bb8-69cade5a36eb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:47.774841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-17cd1c56-a8db-41d2-9bb8-69cade5a36eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:47.785408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:47.792808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:47.854385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 422/838] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:47.866151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f50bd2-c21b-4b1f-a640-4bec8edf7e99 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:47.879421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1c56-a8db-41d2-9bb8-69cade5a36eb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:47.909499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:47.911090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:47.911832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:47.912521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:47.913915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:47.914698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:47.917534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:47.925805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 417/839] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:47.997560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1c56-a8db-41d2-9bb8-69cade5a36eb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:48.039086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:48.039919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.040234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.040485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.053749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:48.061830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:48.062886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:48.063699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 423/840] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:48.069642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.187867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6bb3-5b98-49ca-aff3-f348ee5a84b5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:48.196273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:48.224933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ca877-f7ef-4636-9765-0be8cc07c992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:48.225614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ca877-f7ef-4636-9765-0be8cc07c992 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.225895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ca877-f7ef-4636-9765-0be8cc07c992 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.226187 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ca877-f7ef-4636-9765-0be8cc07c992 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.226949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ca877-f7ef-4636-9765-0be8cc07c992 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:48.227254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ca877-f7ef-4636-9765-0be8cc07c992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:48.228621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ca877-f7ef-4636-9765-0be8cc07c992 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:48.239814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 418/841] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:48.245408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.259255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:48.358083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5620b-3792-4e5d-9045-89b39594be82 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:48.362514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3841a-554a-4294-b3d5-6f68095914dc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.362814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3841a-554a-4294-b3d5-6f68095914dc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.363143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3841a-554a-4294-b3d5-6f68095914dc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.364721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 419/842] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:48.373592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c537ea-bba8-409b-8bb9-0155f479d2f8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.374241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c537ea-bba8-409b-8bb9-0155f479d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.374748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c537ea-bba8-409b-8bb9-0155f479d2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.394018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-60c537ea-bba8-409b-8bb9-0155f479d2f8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:48.395792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60c537ea-bba8-409b-8bb9-0155f479d2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:48.403434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:48.404241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.404518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.404791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.421221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:48.423015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:48.443732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:48.444871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:48.445949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:48.445949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:48.445949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:48.445949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:48.452167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 424/843] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:48.453312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.490208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 420/844] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:48.512923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c537ea-bba8-409b-8bb9-0155f479d2f8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.540364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:48.600776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7cc28-231a-48c8-8fe9-bb0770541a26 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:48.645925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:48.648949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696e734-be65-4565-b77f-c755646f067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:48.649629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696e734-be65-4565-b77f-c755646f067d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.650016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696e734-be65-4565-b77f-c755646f067d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.650325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696e734-be65-4565-b77f-c755646f067d None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.651113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696e734-be65-4565-b77f-c755646f067d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:48.651432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696e734-be65-4565-b77f-c755646f067d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:48.652867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696e734-be65-4565-b77f-c755646f067d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:48.653647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c537ea-bba8-409b-8bb9-0155f479d2f8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:48.672757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 425/845] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:48.673695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696e734-be65-4565-b77f-c755646f067d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.696325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:48.697192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.697402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.697676 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.698390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:48.700623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:48.713852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:48.715717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:48.716555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 421/846] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:48.723571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.814231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696e734-be65-4565-b77f-c755646f067d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:48.837376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb375-ed26-4ad2-a331-e0d62f52fe65 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:48.841783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:48.867457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:48.869206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.869668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.870389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.880455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:48.881339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:48.882092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:48.882476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:48.882693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:48.882897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:48.883695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:48.884088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:48.885760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:48.898405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 422/847] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:48.901140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:48.912191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:48.913189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:00:48.914107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:48.914670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 426/848] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:48.920584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:48.947093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:49.037027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96362c6-40fb-4133-bd7e-f538a3a8d24f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:49.039681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfa524-e2f6-48bf-a957-32f5ae4c7a5f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:49.083939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:49.084635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:49.084983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:49.085327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:49.086278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:49.086658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:49.087757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:49.088241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:49.088862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:49.089394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:49.090160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:49.092096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:49.092640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:49.095283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:49.110210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 423/849] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:49.121517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 427/850] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jul 21 10:00:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:49.127250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:49.278390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:49.289950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d93a-e373-4a59-b2d3-c32b1aaa92da None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:49.330041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:49.330755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:49.331036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:49.331308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:49.409025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:49.410458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:49.530265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:49.541199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 424/851] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:00:49.546443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:49.596056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:49.665601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2c1c-583a-49e5-9969-f9d090981d9a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:49.709580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4274a6-c31e-4a08-b33d-c14f5a46a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:49.710472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4274a6-c31e-4a08-b33d-c14f5a46a33c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:49.710756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4274a6-c31e-4a08-b33d-c14f5a46a33c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:49.711036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4274a6-c31e-4a08-b33d-c14f5a46a33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:49.723497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4274a6-c31e-4a08-b33d-c14f5a46a33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:49.725051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4274a6-c31e-4a08-b33d-c14f5a46a33c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-da4274a6-c31e-4a08-b33d-c14f5a46a33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:49.745033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:49.746084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:49.747061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:49.747061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:49.747061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:49.747061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:49.747061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 428/852] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:49.752867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:49.831953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697068-5bcd-422a-80e8-22c714ea4dc5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:49.832251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697068-5bcd-422a-80e8-22c714ea4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:49.832524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697068-5bcd-422a-80e8-22c714ea4dc5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:49.834069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 429/853] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:49.839606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83227fd-38e8-4a57-85cc-f6fc3b5a23e9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:49.840191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83227fd-38e8-4a57-85cc-f6fc3b5a23e9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:49.840504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83227fd-38e8-4a57-85cc-f6fc3b5a23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:49.859412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c83227fd-38e8-4a57-85cc-f6fc3b5a23e9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:49.860670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c83227fd-38e8-4a57-85cc-f6fc3b5a23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:49.889343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd17fbb-5d79-4620-b616-32b28370f081 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:49.925269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:49.925890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:49.926184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:49.926470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:49.927207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:49.927511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:49.928886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:49.941880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 425/854] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:49.942320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 430/855] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:00:49.951721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:49.961138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83227fd-38e8-4a57-85cc-f6fc3b5a23e9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:49.984184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:50.038554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:50.075188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83227fd-38e8-4a57-85cc-f6fc3b5a23e9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.090361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac3c3-d53a-47af-bf2b-1e0330d2129b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.122813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3de3f-1898-4586-aff7-af5c6a098980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.123983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3de3f-1898-4586-aff7-af5c6a098980 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.124401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3de3f-1898-4586-aff7-af5c6a098980 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.124900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3de3f-1898-4586-aff7-af5c6a098980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.132153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaeb1b-b83c-4aee-a277-6def8727b498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.132153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaeb1b-b83c-4aee-a277-6def8727b498 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.132153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaeb1b-b83c-4aee-a277-6def8727b498 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.132153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaeb1b-b83c-4aee-a277-6def8727b498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.139114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eaeb1b-b83c-4aee-a277-6def8727b498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:50.140835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eaeb1b-b83c-4aee-a277-6def8727b498 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:50.147724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3de3f-1898-4586-aff7-af5c6a098980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e3eaeb1b-b83c-4aee-a277-6def8727b498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:50.157305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:50.158722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:50.160589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-caa3de3f-1898-4586-aff7-af5c6a098980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:50.161341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:50.167042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:00:50.169859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:50.171180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 426/856] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:50.171180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991f21f-8299-4165-93bb-db854dc543af None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.171180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991f21f-8299-4165-93bb-db854dc543af None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.171180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991f21f-8299-4165-93bb-db854dc543af None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.171180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 427/857] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:50.171805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 431/858] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:00:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:00:50.171805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe5cb-7f57-4412-a56f-faa6f445a076 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.172053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991f21f-8299-4165-93bb-db854dc543af None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:50.172202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe5cb-7f57-4412-a56f-faa6f445a076 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.172202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe5cb-7f57-4412-a56f-faa6f445a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.191035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1ecbe5cb-7f57-4412-a56f-faa6f445a076 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:50.192656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1ecbe5cb-7f57-4412-a56f-faa6f445a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:50.276230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 432/859] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:50.279155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe5cb-7f57-4412-a56f-faa6f445a076 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:50.297205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:50.312925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991f21f-8299-4165-93bb-db854dc543af None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.325956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:50.359288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.360206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.360329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.360509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.361306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:50.361618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:50.363084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:50.378916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 428/860] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:50.379491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:50.403755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe5cb-7f57-4412-a56f-faa6f445a076 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.444208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.444822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.445725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.446020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.446873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:50.447258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:50.449848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:50.463720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 433/861] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:00:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:50.463720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:50.520289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7c914-e8c7-4569-98a2-2311f5915b09 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.562731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.563379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:50.563757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.563757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.564080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.564747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:50.566227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:50.582871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 429/862] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:00:50 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:50.583085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:50.619005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed029d-4554-44b4-9b5e-21799853a863 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.623236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:50.688691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.689749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.690254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.691177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.692614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=72498fa7138e4308affc50fa1b1a78fd) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:50.693136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:50.695167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:50.704696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 434/863] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:50 2022] GET /identity/v3/role_assignments?user.id=72498fa7138e4308affc50fa1b1a78fd&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:50.722260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793216e7-28ac-4e55-b26f-9ae8d33345dc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.783784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.785305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.785820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.786295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:50.802972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:50.804525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:50.830036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:50.831162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:50.832028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:50.832028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:50.832028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:50.832028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:50.832028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 430/864] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:50.838637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:50.960284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbc737-6400-4fe0-b17b-1cfa04d80273 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:50.992919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:50.998567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:50.999254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:50.999537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:50.999816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:51.000559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:51.000877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:51.002694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:51.016352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 435/865] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:51.021881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:51.115139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:51.136493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f4d03-c737-4c9d-9973-24aab5596f50 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:51.178727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6892c5-262b-4bc3-a122-05f4c763f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:51.179561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6892c5-262b-4bc3-a122-05f4c763f58f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:51.179844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6892c5-262b-4bc3-a122-05f4c763f58f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:51.180119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6892c5-262b-4bc3-a122-05f4c763f58f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:51.191088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6892c5-262b-4bc3-a122-05f4c763f58f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:51.192560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6892c5-262b-4bc3-a122-05f4c763f58f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-be6892c5-262b-4bc3-a122-05f4c763f58f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:51.212403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:51.213349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:51.214317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:51.215165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 431/866] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:00:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:51.223324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:51.350273 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cff57f-292d-441e-83ae-22d7f13076f8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:51.407570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:51.408285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:51.408572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:51.408849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:51.409714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:51.410028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:51.411495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:51.425306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed2dc-c310-4b5a-aed2-1137cedb00c2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:51.425609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed2dc-c310-4b5a-aed2-1137cedb00c2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:51.425854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed2dc-c310-4b5a-aed2-1137cedb00c2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:51.431371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 432/867] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:51.432691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154e357-d1dd-4f59-af7a-d6fb303e13b8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:51.432978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154e357-d1dd-4f59-af7a-d6fb303e13b8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:51.433254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154e357-d1dd-4f59-af7a-d6fb303e13b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:51.454181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9154e357-d1dd-4f59-af7a-d6fb303e13b8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:51.456628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9154e357-d1dd-4f59-af7a-d6fb303e13b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:51.462797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 436/868] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jul 21 10:00:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:51.473849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:51.567827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 433/869] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:51.586376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154e357-d1dd-4f59-af7a-d6fb303e13b8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:51.651413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:51.700413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:51.739456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154e357-d1dd-4f59-af7a-d6fb303e13b8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:51.784095 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:51.784792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:51.785081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:51.785361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:51.786116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:51.787547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:51.801348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd92e-df2f-41e3-96ff-8b34aead1e95 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:51.819584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 434/870] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:00:51 2022] POST /identity/v3/services => generated 269 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:51.867400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:51.868468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:51.868966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:51.869475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:51.953262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:51.955180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:52.006906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:52.088914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 437/871] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:51 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:00:52.097910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:52.349090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b4af-080d-413a-9f7a-b3ddb6795d71 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:52.400040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:52.400855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:52.401130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:52.401396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:52.403508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:52.412758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:52.414235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:52.433512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:52.435023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:52.435896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:52.435896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:52.435896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:52.435896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:52.435896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 435/872] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:52.441363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:52.560865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88935-bc70-4c8d-9137-ba19604cf29b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:52.605013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:52.605910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:52.606350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:52.606618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:52.607403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:52.607714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:52.609544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:52.622626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 438/873] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:52.628223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:52.742784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d58a-8baa-4610-9a20-75c428baf82f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:52.778131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e8fc-21f6-4799-a338-8f622b28fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:52.779006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e8fc-21f6-4799-a338-8f622b28fd8c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:52.779283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e8fc-21f6-4799-a338-8f622b28fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:52.779602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e8fc-21f6-4799-a338-8f622b28fd8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:52.786658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e8fc-21f6-4799-a338-8f622b28fd8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:52.788105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e8fc-21f6-4799-a338-8f622b28fd8c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0c84e8fc-21f6-4799-a338-8f622b28fd8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:52.803357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:52.805066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:52.806658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 436/874] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:52.814650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:52.826803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:52.901350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d01f0-8891-4997-8c13-fb364c033146 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:52.901961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d01f0-8891-4997-8c13-fb364c033146 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:52.902528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d01f0-8891-4997-8c13-fb364c033146 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:52.908716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 437/875] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:52.910580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f422b-dc99-4046-9ef3-80cc572b7c6f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:52.911086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f422b-dc99-4046-9ef3-80cc572b7c6f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:52.911588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f422b-dc99-4046-9ef3-80cc572b7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:52.930940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-964f422b-dc99-4046-9ef3-80cc572b7c6f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:52.932500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-964f422b-dc99-4046-9ef3-80cc572b7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:52.943062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8cec1-422a-40bd-a795-1c2e246b0652 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:52.978344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:52.985541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb14be-33bb-416d-a75b-9898b2eff954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:52.986236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb14be-33bb-416d-a75b-9898b2eff954 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:52.986537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb14be-33bb-416d-a75b-9898b2eff954 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:52.986806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb14be-33bb-416d-a75b-9898b2eff954 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:52.987597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb14be-33bb-416d-a75b-9898b2eff954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:52.987909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb14be-33bb-416d-a75b-9898b2eff954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:52.989319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb14be-33bb-416d-a75b-9898b2eff954 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.001748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 439/876] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:53.002910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae741e8-07ca-4c5a-9938-3f27761934ae None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.003209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae741e8-07ca-4c5a-9938-3f27761934ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.003491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae741e8-07ca-4c5a-9938-3f27761934ae None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.008823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 440/877] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:53.008823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae741e8-07ca-4c5a-9938-3f27761934ae None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.020163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 438/878] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:53.021579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4dbc-ff86-4afb-b326-850985145fed None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.021766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4dbc-ff86-4afb-b326-850985145fed None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.022013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4dbc-ff86-4afb-b326-850985145fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.046401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7bff4dbc-ff86-4afb-b326-850985145fed None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:53.047691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7bff4dbc-ff86-4afb-b326-850985145fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:53.091672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:53.133779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae741e8-07ca-4c5a-9938-3f27761934ae None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.136512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 439/879] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:53.138668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4dbc-ff86-4afb-b326-850985145fed None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.177556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.178559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.178846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.179128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.179983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=91369e2de7944f68acbaff6d5f8c28ef) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:53.180306 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.181756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.188690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 441/880] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/role_assignments?user.id=91369e2de7944f68acbaff6d5f8c28ef&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:53.189592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.280177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4dbc-ff86-4afb-b326-850985145fed None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.283351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:53.321338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.322624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.323343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.323832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.324841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.326504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:53.341276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:53.342638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:53.343472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:53.346029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 440/881] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:53.352816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.359761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02a8d7-51b9-4a21-b713-7fd7c5455059 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.407576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:53.417467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.418944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.419234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.419798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.420481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.422452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:53.439788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:53.441733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:53.443769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 442/882] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:53.450578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.502451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99b99-c373-4194-b78f-e6bc62d3aca5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.544709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.545972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.546541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.547036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.547974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:53.548578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.550371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.556578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 441/883] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:53.563314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.592391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e373f-1a67-4674-8851-31b2f85ef7e1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.599126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:53.638447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.639137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.639426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.639707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.640552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:53.640870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.644907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.650643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 443/884] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:53.656946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.687142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb984c-c646-41b4-8a23-c3541e954b4e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.725402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.726539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.727121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.727741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.728713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:53.729218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.729974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:53.733079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.745291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 442/885] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:53.747189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:53.777557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc963ba3-fa4d-4150-b479-b40b5bf6122d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.817831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.818539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.818822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.819103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.819837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:53.820139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.821533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.834547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 444/886] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:53.858499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:53.866523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f5ee5-925e-4409-821e-3194d848fcc6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:53.916910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7343191-bcd9-4083-9227-ccad084a5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:53.917610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7343191-bcd9-4083-9227-ccad084a5779 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:53.917891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7343191-bcd9-4083-9227-ccad084a5779 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:53.918840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7343191-bcd9-4083-9227-ccad084a5779 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:53.919674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7343191-bcd9-4083-9227-ccad084a5779 None admin] RBAC: Adding query filter params (interface=public, service_id=07210b1680f84800beb77f2dd2eb310b, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:53.919987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7343191-bcd9-4083-9227-ccad084a5779 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:53.921433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7343191-bcd9-4083-9227-ccad084a5779 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:53.927974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 443/887] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/endpoints?service_id=07210b1680f84800beb77f2dd2eb310b&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:53.933674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:54.066009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd840-b78a-4bd3-8a00-3b5bcc81a57d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:54.091178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:54.104465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6d80-71f6-47a1-8651-105b3235dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:54.105150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6d80-71f6-47a1-8651-105b3235dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:54.105570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6d80-71f6-47a1-8651-105b3235dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:54.105859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6d80-71f6-47a1-8651-105b3235dcf0 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:54.106597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6d80-71f6-47a1-8651-105b3235dcf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:54.107986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6d80-71f6-47a1-8651-105b3235dcf0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:54.114749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 445/888] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:00:53 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:00:54.128262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834caf-6c0b-48ce-b2f7-aada157a3e26 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:54.128567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834caf-6c0b-48ce-b2f7-aada157a3e26 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:54.128825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834caf-6c0b-48ce-b2f7-aada157a3e26 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:54.130875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 444/889] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:54.136743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993b364-2d23-47ee-8087-2f159dc1ee14 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:54.137597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993b364-2d23-47ee-8087-2f159dc1ee14 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:54.137890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993b364-2d23-47ee-8087-2f159dc1ee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:54.156833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b993b364-2d23-47ee-8087-2f159dc1ee14 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:54.158145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b993b364-2d23-47ee-8087-2f159dc1ee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:54.241122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 446/890] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:54.264535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18834caf-6c0b-48ce-b2f7-aada157a3e26 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:54.400683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18834caf-6c0b-48ce-b2f7-aada157a3e26 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:54.437324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:54.438185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:54.438473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:54.438750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:54.439483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:54.440876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:54.454018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:54.455044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:54.455876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 445/891] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jul 21 10:00:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:54.463439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993b364-2d23-47ee-8087-2f159dc1ee14 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:54.578187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993b364-2d23-47ee-8087-2f159dc1ee14 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:54.600149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:54.622144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:54.623284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:54.623775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:54.624282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:54.625211 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:54.625724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:54.627361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:54.634753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 447/892] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:54.641295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:54.669302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:54.748807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e65c4-959d-4bdd-bf95-14dcc17506e1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:54.787759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:54.788442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:54.788731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:54.789009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:54.789727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:54.790040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:54.791479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:54.797357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 446/893] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:54.803729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:54.934423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1057-d792-4fd6-b4f3-a2f96af0e223 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:54.977773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2241aeb-2dd3-4e92-b008-595c410eac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:54.978903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2241aeb-2dd3-4e92-b008-595c410eac5d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:54.979397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2241aeb-2dd3-4e92-b008-595c410eac5d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:54.979949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2241aeb-2dd3-4e92-b008-595c410eac5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:54.981538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2241aeb-2dd3-4e92-b008-595c410eac5d None admin] RBAC: Adding query filter params (interface=public, service_id=08fb79e23d1b4d70b652142866d8c1dc, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:54.982063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2241aeb-2dd3-4e92-b008-595c410eac5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:54.983696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2241aeb-2dd3-4e92-b008-595c410eac5d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:54.990997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 448/894] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:00:54 2022] GET /identity/v3/endpoints?service_id=08fb79e23d1b4d70b652142866d8c1dc&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:54.996931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:55.116985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:55.133582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6277f-eafc-43df-87c5-2e6ea20c8846 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:55.169198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2a52-a581-45c3-a12e-ae760db3115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:55.169934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2a52-a581-45c3-a12e-ae760db3115f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:55.170249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2a52-a581-45c3-a12e-ae760db3115f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:55.170556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2a52-a581-45c3-a12e-ae760db3115f None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:55.171262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2a52-a581-45c3-a12e-ae760db3115f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:55.172651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2a52-a581-45c3-a12e-ae760db3115f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:55.179183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 447/895] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:00:54 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:00:55.588183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c8365-4a29-473e-80d2-2cb60fb0a8c5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:55.588513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c8365-4a29-473e-80d2-2cb60fb0a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:55.588740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c8365-4a29-473e-80d2-2cb60fb0a8c5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:55.590734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 449/896] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:55.596268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea958ccf-9257-4697-b7e7-37bafa79e598 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:55.596560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea958ccf-9257-4697-b7e7-37bafa79e598 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:55.596841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea958ccf-9257-4697-b7e7-37bafa79e598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:55.616476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ea958ccf-9257-4697-b7e7-37bafa79e598 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:55.617990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ea958ccf-9257-4697-b7e7-37bafa79e598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:55.703631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 448/897] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:55.738630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c8365-4a29-473e-80d2-2cb60fb0a8c5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:55.806355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:55.884991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c8365-4a29-473e-80d2-2cb60fb0a8c5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:55.923094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f429b-5811-414c-831a-b3e5f0c31bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:55.923975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f429b-5811-414c-831a-b3e5f0c31bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:55.924257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f429b-5811-414c-831a-b3e5f0c31bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:55.924534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f429b-5811-414c-831a-b3e5f0c31bb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:55.935867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f429b-5811-414c-831a-b3e5f0c31bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a85f429b-5811-414c-831a-b3e5f0c31bb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:00:55.944419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:55.946082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:55.947290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 450/898] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jul 21 10:00:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:55.955347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea958ccf-9257-4697-b7e7-37bafa79e598 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.054680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:56.075988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea958ccf-9257-4697-b7e7-37bafa79e598 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.096699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7f35-d1f8-4be5-8e6e-c0cd6edafc44 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.097048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7f35-d1f8-4be5-8e6e-c0cd6edafc44 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.097254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7f35-d1f8-4be5-8e6e-c0cd6edafc44 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.098890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 451/899] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:56.106124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8904c-109d-4406-bfb6-37e4d50ae7d5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.106759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8904c-109d-4406-bfb6-37e4d50ae7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.107239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8904c-109d-4406-bfb6-37e4d50ae7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.113439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:56.114231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.114513 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.114762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.115579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:56.115892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:56.117292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:56.127208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 449/900] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jul 21 10:00:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:56.129296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d2a8904c-109d-4406-bfb6-37e4d50ae7d5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:56.130632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d2a8904c-109d-4406-bfb6-37e4d50ae7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:56.132309 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.233415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 452/901] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:00:56.256192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8904c-109d-4406-bfb6-37e4d50ae7d5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.263349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7ee2-7ac0-477f-847c-afc2ad04d20b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.305175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d4b8-f51c-4962-b457-f65ee2ea2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:56.306019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:56.307912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d4b8-f51c-4962-b457-f65ee2ea2dac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.308504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d4b8-f51c-4962-b457-f65ee2ea2dac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.309141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d4b8-f51c-4962-b457-f65ee2ea2dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.323255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d4b8-f51c-4962-b457-f65ee2ea2dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:56.325120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d4b8-f51c-4962-b457-f65ee2ea2dac None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:56.334378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7855d4b8-f51c-4962-b457-f65ee2ea2dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:56.361905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:56.363629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:56.365183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:56.365183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:56.365183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:56.365183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:56.368140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 450/902] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:56.370721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d913-ea28-465b-9f72-93a17496b413 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.372055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d913-ea28-465b-9f72-93a17496b413 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.372678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d913-ea28-465b-9f72-93a17496b413 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.374446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 451/903] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:56.375640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d913-ea28-465b-9f72-93a17496b413 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.390817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8904c-109d-4406-bfb6-37e4d50ae7d5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.429829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f646e-b788-493c-b2e9-301395b75b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:56.430952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f646e-b788-493c-b2e9-301395b75b93 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.431253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f646e-b788-493c-b2e9-301395b75b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.431541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f646e-b788-493c-b2e9-301395b75b93 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.432416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f646e-b788-493c-b2e9-301395b75b93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:56.435029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f646e-b788-493c-b2e9-301395b75b93 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:56.452795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 453/904] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:00:56 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:00:56.454003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37781c-93ba-48a8-a98d-10442b2d1559 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.454464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37781c-93ba-48a8-a98d-10442b2d1559 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.454807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37781c-93ba-48a8-a98d-10442b2d1559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.502896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2f37781c-93ba-48a8-a98d-10442b2d1559 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:56.502896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2f37781c-93ba-48a8-a98d-10442b2d1559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:56.538229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d913-ea28-465b-9f72-93a17496b413 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.584179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:56.585124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.585630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.586010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.586913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:56.587343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:56.588837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:56.608972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 452/905] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:56.610358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 454/906] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:56.610482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.636375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37781c-93ba-48a8-a98d-10442b2d1559 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.669654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:56.685771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:56.755429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22833e71-43af-4cce-b05c-7304c9e1de9a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.772340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37781c-93ba-48a8-a98d-10442b2d1559 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.806642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:56.807500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.807786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.808062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.817856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:56.819379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:56.826201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:56.827420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:56.827900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:56.828368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:56.829593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:56.831221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:00:56.843726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:56.844684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:00:56.845593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:56.847809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:56.848760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:00:56.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:56.850342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 453/907] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:00:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:56.852817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 455/908] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:56.852938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.860537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:56.966629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:56.967543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb5204-790d-4d87-89fe-1a388c218db1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.982899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbcb2-cc1d-4b1b-9c8d-aa9cd61378fd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:56.983262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:57.009435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.010124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.010469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.010958 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.011600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:57.011909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.013410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.022996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.024026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.024519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.025197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.026845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:57.027696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.029124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.042805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 454/909] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jul 21 10:00:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:57.044879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 456/910] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:57.045467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:57.053278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:57.171478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588fe0-5892-450c-a96b-1d0057f9e98a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:57.187394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85acbba-4521-4244-bf2a-7066326eeb2e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:57.218538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3118a1-95cc-4be7-80d2-467c9e6923e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.219744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3118a1-95cc-4be7-80d2-467c9e6923e9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.220225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3118a1-95cc-4be7-80d2-467c9e6923e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.220693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3118a1-95cc-4be7-80d2-467c9e6923e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.231479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.232328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.232623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.232912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.233650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:57.233969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.236334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.246553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 457/911] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jul 21 10:00:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:57.251359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:57.278475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:57.282644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:57.323452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3118a1-95cc-4be7-80d2-467c9e6923e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.325832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3118a1-95cc-4be7-80d2-467c9e6923e9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.399600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f36fa-cfa9-46dd-822a-a99cfbd6ec86 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:57.439674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.440251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.440537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.440812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.441572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.442966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.463327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 455/912] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:00:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:00:57.465900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168a25e-b4f0-4cc1-a120-a88512bea69a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.466387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168a25e-b4f0-4cc1-a120-a88512bea69a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.466848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168a25e-b4f0-4cc1-a120-a88512bea69a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.467032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 458/913] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:00:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:57.472669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 456/914] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:57.474547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:57.475340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83017-d0c5-4828-aba9-d6945cf4c9f3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.475812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83017-d0c5-4828-aba9-d6945cf4c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.476239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83017-d0c5-4828-aba9-d6945cf4c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.498094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-69c83017-d0c5-4828-aba9-d6945cf4c9f3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:57.499624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-69c83017-d0c5-4828-aba9-d6945cf4c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:57.589446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:57.592406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:57.618196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 457/915] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:57.637923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83017-d0c5-4828-aba9-d6945cf4c9f3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:57.666889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2576-98db-41bc-b4be-cc6a20bced49 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:57.720403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.721645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.722145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.722680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.736961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.739074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:00:57.761410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:57.763006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:57.763907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:00:57.763907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:00:57.763907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:00:57.763907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:57.764134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 459/916] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:57.769622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:57.792778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83017-d0c5-4828-aba9-d6945cf4c9f3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:57.836640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.837748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.838201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.838637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.839620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.841421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:57.861448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:57.863168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:00:57.864712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:00:57.870280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 458/917] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jul 21 10:00:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:57.872433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:57.913594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f2f49-4fa7-4936-b382-74f55d5f5d72 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:57.941934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:57.957446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:57.974567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:57.976328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:57.977072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:57.977812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:57.979344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:57.980154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:57.983368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:57.999187 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5197f7-d7bf-478d-b603-eb3457ae7eed None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:58.001539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 460/918] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:58.008524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:58.043998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:58.045042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.045521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.045995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.047072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:58.047697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:58.049103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:58.055519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 459/919] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:58.062029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:58.152880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9a47-2ff9-424f-a9cf-c9264cf75dba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:58.190443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cce829-b1a1-4e90-8aa5-e9753b6fc759 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:58.198936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:58.200397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.200696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.200974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.210618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:58.212641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:58.222370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:00:58.232877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:58.233805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:00:58.234698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:58.239921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 461/920] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:58.240911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:58.241973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:58.242982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.243466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.243940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.244865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:58.245592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:58.248773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:58.260262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 460/921] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:58.262449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:58.306766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:58.378828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e20c-22a9-432d-9bf0-c1130a3d43fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:58.393404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff930ec7-04e4-4545-979a-fd3637f361eb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:58.422981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:58.424067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.424537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.425280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.426754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:58.427499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:58.429797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:58.439110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fa796-cb62-445e-9116-5d1a69438170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:58.439874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fa796-cb62-445e-9116-5d1a69438170 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.440726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fa796-cb62-445e-9116-5d1a69438170 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.440726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fa796-cb62-445e-9116-5d1a69438170 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.441608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fa796-cb62-445e-9116-5d1a69438170 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:58.444194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fa796-cb62-445e-9116-5d1a69438170 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:58.447025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 462/922] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:58.453667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:58.475009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 461/923] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:00:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:00:58.609970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de391908-ed80-432f-be62-9debd93703f3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:58.612688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:58.617080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea51ad3-4feb-48bc-baf4-eac93b7b1ece None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.617393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea51ad3-4feb-48bc-baf4-eac93b7b1ece None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.617637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea51ad3-4feb-48bc-baf4-eac93b7b1ece None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.619410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 462/924] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:00:58.625599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78669-91ca-4b33-9b67-0717bf1e2be0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.625905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78669-91ca-4b33-9b67-0717bf1e2be0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.626159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78669-91ca-4b33-9b67-0717bf1e2be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.645829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-71e78669-91ca-4b33-9b67-0717bf1e2be0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:58.647087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-71e78669-91ca-4b33-9b67-0717bf1e2be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:58.658428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:58.659113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.659438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.659785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.660639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] RBAC: Adding query filter params (role.id=2af13917f2cc4f6086e0f8dc5f51a529, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=91369e2de7944f68acbaff6d5f8c28ef) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:58.660955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:58.662572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:58.669499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 463/925] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:00:58 2022] GET /identity/v3/role_assignments?user.id=91369e2de7944f68acbaff6d5f8c28ef&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=2af13917f2cc4f6086e0f8dc5f51a529 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:00:58.703248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:58.751143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 463/926] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:00:58.778016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:58.909059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176c869-202c-4edc-8242-77ac19bfc486 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:58.944372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:58.945192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:58.945475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:58.945751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:58.946460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:58.947843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:00:58.961239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:00:58.962315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:00:58.963155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 464/927] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:00:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:00:58.971771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78669-91ca-4b33-9b67-0717bf1e2be0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:59.093740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78669-91ca-4b33-9b67-0717bf1e2be0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:59.146895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:59.147872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:59.148291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:59.148695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:59.149748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:59.150252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:59.152480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:59.160863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 464/928] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:00:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:59.166579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:59.198893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:59.291241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe149889-3a6c-4219-bb79-a39e261434c6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:59.328453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:59.329486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:59.330148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:59.330633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:59.331735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:59.332181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:59.334320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:59.342818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 465/929] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:00:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:59.348719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:59.400317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:59.469055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314487a-6e24-4a81-9314-41fe64ee1cc8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:59.514453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6680e04-ca24-4551-b5e1-044687f24cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:59.515519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680e04-ca24-4551-b5e1-044687f24cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:59.515997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680e04-ca24-4551-b5e1-044687f24cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:59.516490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680e04-ca24-4551-b5e1-044687f24cd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:59.517501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6680e04-ca24-4551-b5e1-044687f24cd1 None admin] RBAC: Adding query filter params (interface=public, service_id=6e3b09f695954d398fbaee4cf0fc3cfa, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:00:59.518008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6680e04-ca24-4551-b5e1-044687f24cd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:59.519604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6680e04-ca24-4551-b5e1-044687f24cd1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:59.525886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 465/930] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:00:59 2022] GET /identity/v3/endpoints?service_id=6e3b09f695954d398fbaee4cf0fc3cfa&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:00:59.531280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:59.631714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:00:59.641088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbb61c-e85d-4674-b828-001d6337369d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:59.677365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9be70-1a87-4248-9ad5-9fc436e754e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:00:59.678403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9be70-1a87-4248-9ad5-9fc436e754e0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:59.678864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9be70-1a87-4248-9ad5-9fc436e754e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:59.679312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9be70-1a87-4248-9ad5-9fc436e754e0 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:59.680463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9be70-1a87-4248-9ad5-9fc436e754e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:00:59.682781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9be70-1a87-4248-9ad5-9fc436e754e0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:00:59.690648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 466/931] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:00:59 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:00:59.727554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15e7ca-c660-4fc3-a042-05de916020fd None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:59.727854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15e7ca-c660-4fc3-a042-05de916020fd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:59.728120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15e7ca-c660-4fc3-a042-05de916020fd None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:59.729991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 466/932] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:00:59.736428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee550f49-ac41-4088-b5e8-c143ac3b8161 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:00:59.736764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee550f49-ac41-4088-b5e8-c143ac3b8161 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:00:59.736993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee550f49-ac41-4088-b5e8-c143ac3b8161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:00:59.756757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ee550f49-ac41-4088-b5e8-c143ac3b8161 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:00:59.757990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ee550f49-ac41-4088-b5e8-c143ac3b8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:00:59.839053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 467/933] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:00:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:00:59.862767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15e7ca-c660-4fc3-a042-05de916020fd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:00:59.979151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15e7ca-c660-4fc3-a042-05de916020fd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:00:59.981188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:00.017026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:00.018074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:00.018587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:00.019091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:00.020010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:00.021665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:00.023287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING keystone.server.flask.common [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 10:01:00.041823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.sql.core [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 10:01:00.041823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 10:01:00.041823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [parameters: {'id': '6ec46996482248c7a13e8bdcbffbe248', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 10:01:00.041823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ec46996482248c7a13e8bdcbffbe248.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ec46996482248c7a13e8bdcbffbe248. Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:01:00.060051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 10:01:00.061131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application yield resource Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise self.value Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application session.commit() Jul 21 10:01:00.062336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.flush() Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application compat.raise_( Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 10:01:00.063477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 10:01:00.064479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:01:00.065563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [parameters: {'id': '6ec46996482248c7a13e8bdcbffbe248', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:00.066477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:00.067459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ec46996482248c7a13e8bdcbffbe248. Jul 21 10:01:00.068460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:00.070894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 467/934] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Jul 21 10:00:59 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:00.077689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee550f49-ac41-4088-b5e8-c143ac3b8161 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:00.186764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:00.203102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee550f49-ac41-4088-b5e8-c143ac3b8161 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:00.240523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11643-7663-468a-845a-0e6f6d2360c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:00.241642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11643-7663-468a-845a-0e6f6d2360c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:00.242208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11643-7663-468a-845a-0e6f6d2360c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:00.242665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11643-7663-468a-845a-0e6f6d2360c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:00.249994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11643-7663-468a-845a-0e6f6d2360c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:00.251693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11643-7663-468a-845a-0e6f6d2360c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b4d11643-7663-468a-845a-0e6f6d2360c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:01:00.267261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:00.268449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:00.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:00.271829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 468/935] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:00.278732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:00.394602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb9c9-4ea8-4207-a5c6-1dfee5488844 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:00.440284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e632fd-a712-4597-8e7e-ee3c31f2813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:00.441540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e632fd-a712-4597-8e7e-ee3c31f2813c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:00.442025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e632fd-a712-4597-8e7e-ee3c31f2813c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:00.442557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e632fd-a712-4597-8e7e-ee3c31f2813c None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:00.443986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e632fd-a712-4597-8e7e-ee3c31f2813c None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:00.444376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e632fd-a712-4597-8e7e-ee3c31f2813c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:00.446277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e632fd-a712-4597-8e7e-ee3c31f2813c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:00.478340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 468/936] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:01:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:00.862653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa5b0-59f3-46da-8f58-ef4d3bb2cfdb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:00.863069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa5b0-59f3-46da-8f58-ef4d3bb2cfdb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:00.863204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa5b0-59f3-46da-8f58-ef4d3bb2cfdb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:00.864848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 469/937] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:00.870530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061be49-383c-41e6-8f3f-7e01c3d59e70 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:00.870921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061be49-383c-41e6-8f3f-7e01c3d59e70 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:00.871105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061be49-383c-41e6-8f3f-7e01c3d59e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:00.890979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b061be49-383c-41e6-8f3f-7e01c3d59e70 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:00.892567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b061be49-383c-41e6-8f3f-7e01c3d59e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:00.908653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:00.952514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294eb1-89c8-476e-96a1-2356b00f2751 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:00.952856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294eb1-89c8-476e-96a1-2356b00f2751 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:00.953075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294eb1-89c8-476e-96a1-2356b00f2751 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:00.954777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 470/938] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:00.960153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76023887-2143-45d5-a9b3-48a0f6d5b886 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:00.960437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76023887-2143-45d5-a9b3-48a0f6d5b886 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:00.960716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76023887-2143-45d5-a9b3-48a0f6d5b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:00.967794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 469/939] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:00.979282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-76023887-2143-45d5-a9b3-48a0f6d5b886 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:00.981041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-76023887-2143-45d5-a9b3-48a0f6d5b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:00.990133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061be49-383c-41e6-8f3f-7e01c3d59e70 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.076571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 471/940] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:01.100014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061be49-383c-41e6-8f3f-7e01c3d59e70 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:01.100238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76023887-2143-45d5-a9b3-48a0f6d5b886 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.144980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:01.145761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.146047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.146395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.147242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:01.148632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:01.162083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:01.163184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:01.164009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:01.168519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 470/941] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:01.169605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.192598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:01.201039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:01.228949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76023887-2143-45d5-a9b3-48a0f6d5b886 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:01.269796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:01.271203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.271689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.272197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.285196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:01.290750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0381a30-cc71-48cc-a31f-80bfb9acf79e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:01.295274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:01.296245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:01.297068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:01.300043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 472/942] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:01.311650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.328893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:01.330050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.330568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.331078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.332120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:01.332632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:01.334322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:01.341150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 471/943] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:01.346780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.427791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f6381-fc75-4826-afe2-35294d39d064 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:01.434584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:01.462779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916495ee-7be0-40ed-a4a2-76a8b976b8c7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:01.465784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:01.466546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.466830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.467107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.467878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:01.468189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:01.471501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:01.477334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:01.485180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 473/944] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:01.492700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.516591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:01.517339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.517624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.517951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.518779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:01.519184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:01.520503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:01.530505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 472/945] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:01.619505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926967a-0336-4e12-81df-2a8392c1b7cb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:01.659993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4717-d02e-4168-bbb7-5482f3eab6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:01.661198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4717-d02e-4168-bbb7-5482f3eab6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.661720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4717-d02e-4168-bbb7-5482f3eab6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.662228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4717-d02e-4168-bbb7-5482f3eab6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.676154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b4717-d02e-4168-bbb7-5482f3eab6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:01.678063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b4717-d02e-4168-bbb7-5482f3eab6d1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-620b4717-d02e-4168-bbb7-5482f3eab6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:01.697203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:01.698185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:01.699129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:01.699129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:01.699129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:01.699129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:01.699972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 474/946] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:01.705464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.817078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae306e-cc41-4d7a-8389-5f60f63b8c43 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:01.854301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:01.854784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1a66f-6482-4e7f-9fcd-3fc28ab5641d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.855105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1a66f-6482-4e7f-9fcd-3fc28ab5641d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.855391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1a66f-6482-4e7f-9fcd-3fc28ab5641d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.856023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.856519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.856989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.857925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:01.858463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:01.860060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:01.860711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 475/947] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:01.862456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61c62-c151-4d7e-b213-d761ab36a6a2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:01.862746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61c62-c151-4d7e-b213-d761ab36a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:01.863023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61c62-c151-4d7e-b213-d761ab36a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:01.872870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:01.877063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 473/948] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:01.883160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:01.888123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-85e61c62-c151-4d7e-b213-d761ab36a6a2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:01.889311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-85e61c62-c151-4d7e-b213-d761ab36a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:01.939370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:01.966281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 476/949] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:01.988271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e61c62-c151-4d7e-b213-d761ab36a6a2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.015754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db339d6-18f5-446f-85d7-71a480d83c64 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.067905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.069245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.069726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.070235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.079540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.081431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:01:02.098453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:02.099420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:01:02.100369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:02.103080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 474/950] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:02.110338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.118935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e61c62-c151-4d7e-b213-d761ab36a6a2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.176069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.177854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.178492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.178973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.179904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.181526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:02.195127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:02.196166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:02.197014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:02.198135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:02.205048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 477/951] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:01:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:02.206629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.264537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:02.274423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dc90f-d62f-4425-95da-d8549f7b0fea None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.334764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.336791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.337234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.337694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.338744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:02.339087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49d9fa-a0c6-49de-bbcf-d46b4cb4c009 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.339373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.342084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.372442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 475/952] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jul 21 10:01:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:02.375214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.394120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.395105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.395572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.396026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.397317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:02.397832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.399413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.410464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 478/953] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:01:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:02.411805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.507654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2486d2-16c8-4665-a59e-f4c18b1df297 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.528154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:02.542618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ca64-7b95-4216-8c72-c3a10b180cf6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.551532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.552725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.553224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.553710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.554205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:02.570386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.573172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.585395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.586140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.586473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.586800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.587538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:02.587854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.589476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.600123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 479/954] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:01:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:02.601445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:02.603698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:02.605807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:02.607439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:02.607439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:02.607439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:02.607439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:02.614666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 476/955] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:02.615916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.722811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e13a6-5e2a-49ac-9fa7-a745457ab771 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.726976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02c72-d624-42fb-8df9-fdb0f623fc78 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:02.763534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a05b2-31ea-4b31-8524-e5c8940d6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.764174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a05b2-31ea-4b31-8524-e5c8940d6cdd None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.764459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a05b2-31ea-4b31-8524-e5c8940d6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.764748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a05b2-31ea-4b31-8524-e5c8940d6cdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.765502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a05b2-31ea-4b31-8524-e5c8940d6cdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.766423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb368709-1b02-4648-948b-a000e6a81902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:02.766904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a05b2-31ea-4b31-8524-e5c8940d6cdd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.767543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb368709-1b02-4648-948b-a000e6a81902 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.768041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb368709-1b02-4648-948b-a000e6a81902 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.768515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb368709-1b02-4648-948b-a000e6a81902 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.769463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb368709-1b02-4648-948b-a000e6a81902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:02.769984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb368709-1b02-4648-948b-a000e6a81902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:02.771600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb368709-1b02-4648-948b-a000e6a81902 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:02.792041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 480/956] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:01:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:02.792041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8726d77-6d79-44f6-ada5-9574f3ba6f6b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.792041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8726d77-6d79-44f6-ada5-9574f3ba6f6b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.792041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8726d77-6d79-44f6-ada5-9574f3ba6f6b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.792498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 481/957] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:02.793291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 477/958] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:02.793949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8726d77-6d79-44f6-ada5-9574f3ba6f6b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.797784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec6a4-c156-4d12-9c67-5a46a0bca7ca None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:02.798472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec6a4-c156-4d12-9c67-5a46a0bca7ca None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:02.798962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec6a4-c156-4d12-9c67-5a46a0bca7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:02.818497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-06aec6a4-c156-4d12-9c67-5a46a0bca7ca None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:02.820083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-06aec6a4-c156-4d12-9c67-5a46a0bca7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:02.840323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:02.863008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:02.934197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 478/959] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:02.958740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aec6a4-c156-4d12-9c67-5a46a0bca7ca None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:02.972518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8726d77-6d79-44f6-ada5-9574f3ba6f6b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:03.018777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:03.019515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.019800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.020078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.028903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:03.030771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:01:03.053622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:03.055302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:03.056790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 482/960] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:03.066456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:03.118430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aec6a4-c156-4d12-9c67-5a46a0bca7ca None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:03.161206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:03.161986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.162319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.162576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.163354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:03.165205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:03.189667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:03.189878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.sql.core [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 10:01:03.189878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 10:01:03.189878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [parameters: {'user_id': '9dc68f59174141e891fcab0a130f3644', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 10:01:03.189878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 21 10:01:03.197504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:01:03.198459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application yield resource Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise self.value Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application session.commit() Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 10:01:03.199423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.flush() Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application compat.raise_( Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 10:01:03.200315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:01:03.201926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:01:03.203188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [parameters: {'user_id': '9dc68f59174141e891fcab0a130f3644', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:03.205220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 10:01:03.207923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 479/961] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jul 21 10:01:02 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:03.211228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:03.226034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85e1f-a555-4217-b8a0-f1b69b8d3f69 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:03.229823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:03.279802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:03.281016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.281447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.281887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.283369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:03.283831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:03.285724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:03.307889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 483/962] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:03.309115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:03.353526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7922076-1d86-44b1-87b6-1722b4d37c7c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:03.399357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:03.400921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.401363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.401818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.413156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:03.415628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:03.430917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b854f-7b0f-400e-bb03-be42a8368db0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:01:03.435428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:03.436970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:01:03.438814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:03.445163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 480/963] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:01:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:03.446143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:03.481335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2557189-0a26-4c00-b55c-49e7a20ae550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:03.482884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557189-0a26-4c00-b55c-49e7a20ae550 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.483372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557189-0a26-4c00-b55c-49e7a20ae550 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.483838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557189-0a26-4c00-b55c-49e7a20ae550 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/91369e2de7944f68acbaff6d5f8c28ef/roles/2af13917f2cc4f6086e0f8dc5f51a529` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.487652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2557189-0a26-4c00-b55c-49e7a20ae550 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=91369e2de7944f68acbaff6d5f8c28ef, role_id=2af13917f2cc4f6086e0f8dc5f51a529)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:03.490061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2557189-0a26-4c00-b55c-49e7a20ae550 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:03.509195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 484/964] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:01:03 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/91369e2de7944f68acbaff6d5f8c28ef/roles/2af13917f2cc4f6086e0f8dc5f51a529 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:01:03.574129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:03.603433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56779519-265e-4821-81f0-110ef0c0816a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:03.648329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:03.649465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.650050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.650549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.651673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:03.652693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:03.654437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:03.674933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7bed1-6dc1-4bb7-8c4e-6b6bad4b1092 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.675269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7bed1-6dc1-4bb7-8c4e-6b6bad4b1092 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.675504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7bed1-6dc1-4bb7-8c4e-6b6bad4b1092 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.677209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 485/965] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:03.683768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a8b3-ceba-41ba-91d0-697beafe422f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:03.683768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a8b3-ceba-41ba-91d0-697beafe422f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:03.683768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a8b3-ceba-41ba-91d0-697beafe422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:03.701638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 481/966] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jul 21 10:01:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:03.704420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2705a8b3-ceba-41ba-91d0-697beafe422f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:03.705955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2705a8b3-ceba-41ba-91d0-697beafe422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:03.708512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:03.799791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 486/967] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:03.832446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:03.957064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f751f-b12f-4b6e-941a-7120f568dee4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:04.000942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4b566-011a-4fe5-a3f6-7eaad0739e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:04.001634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4b566-011a-4fe5-a3f6-7eaad0739e00 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:04.001919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4b566-011a-4fe5-a3f6-7eaad0739e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:04.002268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4b566-011a-4fe5-a3f6-7eaad0739e00 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:04.002971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4b566-011a-4fe5-a3f6-7eaad0739e00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:04.004370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4b566-011a-4fe5-a3f6-7eaad0739e00 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:04.008157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:04.021063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 482/968] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:01:03 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:04.993549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e0fc-7e7e-4653-bcec-816d1652e16c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:04.994197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e0fc-7e7e-4653-bcec-816d1652e16c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:04.994197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e0fc-7e7e-4653-bcec-816d1652e16c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:04.995770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 487/969] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:05.001772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13433d3-09d9-45a0-8829-672b11a80738 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.002257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13433d3-09d9-45a0-8829-672b11a80738 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.002445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13433d3-09d9-45a0-8829-672b11a80738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.019400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a13433d3-09d9-45a0-8829-672b11a80738 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:05.020924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a13433d3-09d9-45a0-8829-672b11a80738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:05.110254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 483/970] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:05.130744 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e0fc-7e7e-4653-bcec-816d1652e16c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:05.246187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e0fc-7e7e-4653-bcec-816d1652e16c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:05.289669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:05.290511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.290795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.291070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.291730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:05.293676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:05.306549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:05.307661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:05.308536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 488/971] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:01:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:05.316688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13433d3-09d9-45a0-8829-672b11a80738 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:05.433980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13433d3-09d9-45a0-8829-672b11a80738 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:05.468638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:05.483936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:05.484620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.484903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.485184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.485906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:05.486241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:05.487634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:05.495583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 484/972] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:01:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:05.501523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:05.504639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:05.612019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40ce80-00cc-44f3-b143-10fd553013aa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:05.646901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0d1da-b2cf-455e-a064-0743c20a7cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:05.647574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d1da-b2cf-455e-a064-0743c20a7cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.647855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d1da-b2cf-455e-a064-0743c20a7cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.648125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d1da-b2cf-455e-a064-0743c20a7cf7 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.648836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0d1da-b2cf-455e-a064-0743c20a7cf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:05.649166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0d1da-b2cf-455e-a064-0743c20a7cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:05.650540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0d1da-b2cf-455e-a064-0743c20a7cf7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:05.661181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 489/973] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:01:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:05.662426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:05.685046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f5fa-9a93-42a3-aacb-bc24eacc5914 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.685390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f5fa-9a93-42a3-aacb-bc24eacc5914 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.685618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f5fa-9a93-42a3-aacb-bc24eacc5914 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.687182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 490/974] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:05.692386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e66c-f294-45a7-ab26-746d238e5ef0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.692684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e66c-f294-45a7-ab26-746d238e5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.692968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e66c-f294-45a7-ab26-746d238e5ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.711892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0d14e66c-f294-45a7-ab26-746d238e5ef0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:05.713074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d14e66c-f294-45a7-ab26-746d238e5ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:05.787538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:05.791678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6ac58-cd71-4b4d-9a4f-d24555413f89 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:05.796822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 491/975] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:05.819827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14e66c-f294-45a7-ab26-746d238e5ef0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:05.835223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:05.836292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.836719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.837111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.838074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] RBAC: Adding query filter params (interface=admin, service_id=6e3b09f695954d398fbaee4cf0fc3cfa, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:05.838429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:05.840706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:05.852061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 485/976] 10.222.0.23 () {56 vars in 1249 bytes} [Thu Jul 21 10:01:05 2022] GET /identity/v3/endpoints?service_id=6e3b09f695954d398fbaee4cf0fc3cfa&interface=admin®ion_id=RegionOne => generated 193 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:05.852979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:05.913728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:05.926449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14e66c-f294-45a7-ab26-746d238e5ef0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:05.962720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:05.963545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:05.963833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:05.964108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:05.975531 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:05.978298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7de4eb-287d-419e-9fc1-c0b663bff68a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:05.983964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:05.988510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:05.990225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 492/977] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jul 21 10:01:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:05.992284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.023392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.024071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.024379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.024635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.025332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.026795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.033884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 486/978] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:01:05 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:01:06.067517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:06.124938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6234ac-5212-4413-b25d-75f80a878acd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.167671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce2f33-8d48-4041-a222-99f42d88b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.168363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce2f33-8d48-4041-a222-99f42d88b05a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.168647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce2f33-8d48-4041-a222-99f42d88b05a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.168924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce2f33-8d48-4041-a222-99f42d88b05a None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.169710 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce2f33-8d48-4041-a222-99f42d88b05a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:06.170019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce2f33-8d48-4041-a222-99f42d88b05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.171487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce2f33-8d48-4041-a222-99f42d88b05a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.185853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 493/979] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jul 21 10:01:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:06.187173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.199700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e7ad-dc61-4b7d-aa29-c73664ffafce None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.200036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e7ad-dc61-4b7d-aa29-c73664ffafce None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.200282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e7ad-dc61-4b7d-aa29-c73664ffafce None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.202121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 494/980] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:06.209860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d9ed-11f4-4f43-8998-75f99f8272a7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.209860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d9ed-11f4-4f43-8998-75f99f8272a7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.209860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d9ed-11f4-4f43-8998-75f99f8272a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.233081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b522d9ed-11f4-4f43-8998-75f99f8272a7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:06.234342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b522d9ed-11f4-4f43-8998-75f99f8272a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:06.310209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 495/981] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:06.312075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7ea0-5c9f-49e2-875c-d69c8646faaf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.331625 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:06.333418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522d9ed-11f4-4f43-8998-75f99f8272a7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.353537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.354377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.354663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.354973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.366460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.367934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:06.389500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:06.390508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:06.396216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:06.396216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:06.396216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:06.396216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:06.396216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 487/982] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:06.396703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.403307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:06.471239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522d9ed-11f4-4f43-8998-75f99f8272a7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.515867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6504d8d-7a85-4310-9da8-dfe896f4e4d2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.516073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.516766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.517051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.517326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.517983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.519397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:06.532625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:06.533668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:06.534658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 496/983] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:06.539798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.565719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.566954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.567415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.568151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.569325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:06.570045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.572204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.587917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 488/984] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:06.593782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.630998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:06.649003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2065-fcf2-4943-9886-d6392b6ffef2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.663609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:06.688359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.689416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.689416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.689612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.690307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:06.690616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.692167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.698075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 497/985] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:06.704009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.725642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfcbe-55e8-4852-9c58-70e96e7b0c21 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.767963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.768794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.769079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.769351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.779646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.780535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:01:06.797461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:06.798640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:06.799557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 489/986] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:06.804343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.835896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64054f1f-76fd-4c1f-bb67-6641dbf878b6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.873784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.874274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.874578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.874819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.875532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:06.875842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.877230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:06.886211 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 498/987] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:06.888178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:06.912497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:06.933358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00288ffb-aca5-4c35-a3a9-8805221ed2e7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:06.939402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:06.991130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:06.992210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:06.992670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:06.993129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:06.994659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:06.995171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:06.997473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:07.017719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 490/988] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:07.023469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:07.033647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b117a-5443-41df-b05c-54f9c3283de5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:07.086275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:07.087118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:07.087398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:07.087676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:07.088482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] RBAC: Adding query filter params (interface=public, service_id=8a60ca9caa244d5fa5f54cd0f7ed1bca, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:07.088796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:07.091025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:07.098056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 499/989] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:01:06 2022] GET /identity/v3/endpoints?service_id=8a60ca9caa244d5fa5f54cd0f7ed1bca&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:07.103394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:07.145556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008bf34-f141-4b89-87c5-4f11c75ef80d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:07.184988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:07.186093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:07.186621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:07.187043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:07.204592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:07.219215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7b39f-f97b-493a-a932-414b9ed755c0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:07.222961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:07.261647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:07.262349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:07.262751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:07.263137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:07.263733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:07.265120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:07.266214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:07.267846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:07.271644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 500/990] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:01:07 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:01:07.406793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 491/991] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:07 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:01:07.413128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:07.541409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36adfcd-d0ac-4a36-b550-8dba8f1c6749 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:07.578121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:07.579159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:07.579562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:07.579932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:07.592327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:07.593928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:07.613348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:07.614590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:07.615735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:07.615735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:07.615735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:07.615735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:07.618225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 501/992] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:07.622956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:07.672369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:07.735478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7c99-fb43-4c50-9a1a-0abf62fed825 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:07.778305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:07.778988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:07.779271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:07.779590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:07.780336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:07.780723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:07.782027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:07.794644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 492/993] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:07.800216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:07.824294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:07.911163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381ea9b-cbfa-4a40-bc72-0d4380cfb39f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:07.946598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a11563-ace3-4f16-a78d-33dffdfce7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:07.947411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a11563-ace3-4f16-a78d-33dffdfce7bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:07.947763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a11563-ace3-4f16-a78d-33dffdfce7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:07.948102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a11563-ace3-4f16-a78d-33dffdfce7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:07.956562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a11563-ace3-4f16-a78d-33dffdfce7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:07.958112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a11563-ace3-4f16-a78d-33dffdfce7bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-12a11563-ace3-4f16-a78d-33dffdfce7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:01:07.973848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:07.975027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:07.976165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:07.977968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 502/994] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:07.982918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:08.095294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b97e5-6d1d-4e7d-a552-c65d2e80fdc7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:08.097735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:08.129424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec9db-9758-4c9e-950e-af5a8a1fef87 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.130087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec9db-9758-4c9e-950e-af5a8a1fef87 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.130087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec9db-9758-4c9e-950e-af5a8a1fef87 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.131517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 503/995] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:08.136974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b2ea-7fa1-48ec-a277-e096017235e3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.137264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b2ea-7fa1-48ec-a277-e096017235e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.137365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:08.137541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b2ea-7fa1-48ec-a277-e096017235e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.138066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.138479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.138596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.139377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:08.139693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:08.141141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:08.158461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 493/996] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:01:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:08.158676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-abc0b2ea-7fa1-48ec-a277-e096017235e3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:08.159214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-abc0b2ea-7fa1-48ec-a277-e096017235e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:08.160021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:08.232011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 504/997] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:08.255218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0b2ea-7fa1-48ec-a277-e096017235e3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:08.268081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362341-4a5d-468f-9ec9-7a9e81b263a0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:08.268326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:08.306193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:08.306978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.307263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.307674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.309020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] RBAC: Adding query filter params (role.id=2af13917f2cc4f6086e0f8dc5f51a529, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=91369e2de7944f68acbaff6d5f8c28ef) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:08.309336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:08.310942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:08.317948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 494/998] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:08 2022] GET /identity/v3/role_assignments?user.id=91369e2de7944f68acbaff6d5f8c28ef&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=2af13917f2cc4f6086e0f8dc5f51a529 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:08.366792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0b2ea-7fa1-48ec-a277-e096017235e3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:08.422847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:08.423695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.423980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.424258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.424930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:08.426439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:08.440326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:08.441393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:08.442321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 505/999] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jul 21 10:01:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:08.448119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:08.488223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:08.569532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f16be-a14d-4274-bf92-e1ae48d43a13 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:08.608642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:08.609324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.609608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.609885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.610634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:08.610946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:08.612332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:08.623043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 495/1000] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:01:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:08.624241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:08.706159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:08.735255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc028a7-476e-4af1-ab46-2533f6a98333 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:08.774895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b207-60a4-4d16-b181-411dcafb3cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:08.775583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b207-60a4-4d16-b181-411dcafb3cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.775961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b207-60a4-4d16-b181-411dcafb3cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.776279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b207-60a4-4d16-b181-411dcafb3cb5 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.777101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b207-60a4-4d16-b181-411dcafb3cb5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:08.777474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b207-60a4-4d16-b181-411dcafb3cb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:08.779035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b207-60a4-4d16-b181-411dcafb3cb5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:08.789023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 506/1001] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jul 21 10:01:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:08.790227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:08.889628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:08.899611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b46553-cdfc-4691-b6c8-1084c23e63ac None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:08.936455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ded69c-efcc-4c16-a1ad-a31b88358272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:08.937233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ded69c-efcc-4c16-a1ad-a31b88358272 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:08.937587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ded69c-efcc-4c16-a1ad-a31b88358272 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:08.937932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ded69c-efcc-4c16-a1ad-a31b88358272 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:08.938809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ded69c-efcc-4c16-a1ad-a31b88358272 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:08.940253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ded69c-efcc-4c16-a1ad-a31b88358272 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:08.965763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 496/1002] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:01:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:01:09.359092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed615a60-f2fc-42e8-8891-82cf0696b0ec None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:09.359656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed615a60-f2fc-42e8-8891-82cf0696b0ec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:09.359656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed615a60-f2fc-42e8-8891-82cf0696b0ec None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:09.361146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 507/1003] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:09.366363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087b01a-f0e9-47d1-9a36-7033a8768253 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:09.366771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087b01a-f0e9-47d1-9a36-7033a8768253 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:09.366959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087b01a-f0e9-47d1-9a36-7033a8768253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:09.385351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e087b01a-f0e9-47d1-9a36-7033a8768253 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:09.387087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e087b01a-f0e9-47d1-9a36-7033a8768253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:09.486806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 497/1004] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:09.510865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed615a60-f2fc-42e8-8891-82cf0696b0ec None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:09.621063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed615a60-f2fc-42e8-8891-82cf0696b0ec None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:09.656161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:09.656981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:09.657270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:09.657550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:09.658239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:09.659645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:09.672575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:09.673647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:01:09.675168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:09.678329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 508/1005] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:09.680005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087b01a-f0e9-47d1-9a36-7033a8768253 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:09.774538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:09.799871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087b01a-f0e9-47d1-9a36-7033a8768253 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:09.835463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:09.836135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:09.836414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:09.836683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:09.837394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:09.837700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:09.839608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:09.850519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 498/1006] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:01:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:09.854214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:09.857734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:09.962841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad563d-3932-4b48-934a-4bddf6acdc1e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:09.999372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483cbbc-d9bd-46b0-8dd5-16b3a37c6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:10.000039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483cbbc-d9bd-46b0-8dd5-16b3a37c6d53 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:10.000321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483cbbc-d9bd-46b0-8dd5-16b3a37c6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:10.000596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483cbbc-d9bd-46b0-8dd5-16b3a37c6d53 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:10.001330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483cbbc-d9bd-46b0-8dd5-16b3a37c6d53 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:10.001636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483cbbc-d9bd-46b0-8dd5-16b3a37c6d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:10.003060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483cbbc-d9bd-46b0-8dd5-16b3a37c6d53 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:10.013139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 509/1007] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jul 21 10:01:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:10.014429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:10.127243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a8308-3b09-4872-a4f5-c54af5a7ef72 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:10.166384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310346a-cb62-44a8-a828-6185da2561be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:10.167057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310346a-cb62-44a8-a828-6185da2561be None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:10.167886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310346a-cb62-44a8-a828-6185da2561be None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:10.168166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310346a-cb62-44a8-a828-6185da2561be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:10.168912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310346a-cb62-44a8-a828-6185da2561be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:10.170342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310346a-cb62-44a8-a828-6185da2561be None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:10.185589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:10.198194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 499/1008] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:01:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:10.455877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc7d1e-84b3-4678-8ffc-7f5fadf9273d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:10.456405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc7d1e-84b3-4678-8ffc-7f5fadf9273d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:10.456774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc7d1e-84b3-4678-8ffc-7f5fadf9273d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:10.459088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 510/1009] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:10.473908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284869af-e798-4b6b-adf6-1d76d43dfa52 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:10.474735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284869af-e798-4b6b-adf6-1d76d43dfa52 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:10.474873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284869af-e798-4b6b-adf6-1d76d43dfa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:10.496389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-284869af-e798-4b6b-adf6-1d76d43dfa52 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:10.497605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-284869af-e798-4b6b-adf6-1d76d43dfa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:10.578742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 500/1010] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:10.600781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc7d1e-84b3-4678-8ffc-7f5fadf9273d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:10.673380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:10.716294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc7d1e-84b3-4678-8ffc-7f5fadf9273d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:10.753499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:10.754343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:10.754628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:10.754903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] PATH_INFO: `/v3/services/image` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:10.755562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:10.756953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:10.769476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:10.771769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:10.773453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:10.778284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 511/1011] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jul 21 10:01:10 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:10.780520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284869af-e798-4b6b-adf6-1d76d43dfa52 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:10.896885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284869af-e798-4b6b-adf6-1d76d43dfa52 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:10.932685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:10.946790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12796e8-f332-4f6e-8c47-15ec5d85aa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:10.947480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12796e8-f332-4f6e-8c47-15ec5d85aa36 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:10.947762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12796e8-f332-4f6e-8c47-15ec5d85aa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:10.948037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12796e8-f332-4f6e-8c47-15ec5d85aa36 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:10.948797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12796e8-f332-4f6e-8c47-15ec5d85aa36 None admin] RBAC: Adding query filter params (name=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:10.949102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12796e8-f332-4f6e-8c47-15ec5d85aa36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:10.950517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12796e8-f332-4f6e-8c47-15ec5d85aa36 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:10.960678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 501/1012] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:10.961895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:11.062066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d7656-6733-4809-b41a-34653a4cc041 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:11.062486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d7656-6733-4809-b41a-34653a4cc041 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:11.062669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d7656-6733-4809-b41a-34653a4cc041 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:11.064345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 502/1013] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:11.070052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a8a1-4766-4315-b5ee-f3d684b26a50 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:11.070367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a8a1-4766-4315-b5ee-f3d684b26a50 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:11.070639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a8a1-4766-4315-b5ee-f3d684b26a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:11.070875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bc53-b1b8-4057-a20e-dbee25fb6c9e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:11.091120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5167a8a1-4766-4315-b5ee-f3d684b26a50 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:11.092320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5167a8a1-4766-4315-b5ee-f3d684b26a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:11.104504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:11.110859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:11.111534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:11.111817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:11.112095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:11.112804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:11.113113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:11.114520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:11.119291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 512/1014] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:11.181776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 503/1015] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:11.205124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:11.317199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec50266-1756-480c-b435-9f3783175ee5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:11.355455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f726dd-9698-4e2a-b819-f337e4c69114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:11.356268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f726dd-9698-4e2a-b819-f337e4c69114 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:11.356598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f726dd-9698-4e2a-b819-f337e4c69114 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:11.356875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f726dd-9698-4e2a-b819-f337e4c69114 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:11.358082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f726dd-9698-4e2a-b819-f337e4c69114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:11.359548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f726dd-9698-4e2a-b819-f337e4c69114 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:11.361641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 513/1016] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:11.367380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a8a1-4766-4315-b5ee-f3d684b26a50 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:11.481831 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a8a1-4766-4315-b5ee-f3d684b26a50 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:11.509504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:11.532613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f9f73-ef3c-4c52-bb0e-41bc596e708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:11.533296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f9f73-ef3c-4c52-bb0e-41bc596e708d None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:11.533585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f9f73-ef3c-4c52-bb0e-41bc596e708d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:11.533864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f9f73-ef3c-4c52-bb0e-41bc596e708d None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:11.534631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f9f73-ef3c-4c52-bb0e-41bc596e708d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:11.536075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f9f73-ef3c-4c52-bb0e-41bc596e708d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:11.574293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 504/1017] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:01:11 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:12.401433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fe65a-bc7b-4c69-b4a4-1778932b0bd6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:12.401965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fe65a-bc7b-4c69-b4a4-1778932b0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:12.402072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fe65a-bc7b-4c69-b4a4-1778932b0bd6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:12.403562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 514/1018] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:12.409042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b6b9-2ca3-4f4c-8bf8-7cdf997bdc51 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:12.409339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b6b9-2ca3-4f4c-8bf8-7cdf997bdc51 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:12.409628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b6b9-2ca3-4f4c-8bf8-7cdf997bdc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:12.427673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ebd7b6b9-2ca3-4f4c-8bf8-7cdf997bdc51 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:12.428867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ebd7b6b9-2ca3-4f4c-8bf8-7cdf997bdc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:12.522064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 505/1019] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:12.546377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fe65a-bc7b-4c69-b4a4-1778932b0bd6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:12.612642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:12.655268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fe65a-bc7b-4c69-b4a4-1778932b0bd6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:12.688914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:12.689734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:12.690015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:12.690332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:12.700963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:12.709142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:12.710737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:12.711661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 515/1020] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jul 21 10:01:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:12.717458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7b6b9-2ca3-4f4c-8bf8-7cdf997bdc51 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:12.834734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:12.838837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7b6b9-2ca3-4f4c-8bf8-7cdf997bdc51 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:12.887142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:12.887896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:12.888116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:12.888400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:12.889167 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:12.889475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:12.890887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:12.904830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 506/1021] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jul 21 10:01:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:12.906247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:13.010316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93499619-278c-438c-a82a-3f592d3eefda None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:13.036154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:13.049092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fb4ba-eb22-4bbc-aa2a-bb93d93e3a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:13.049892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fb4ba-eb22-4bbc-aa2a-bb93d93e3a5d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.050200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fb4ba-eb22-4bbc-aa2a-bb93d93e3a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.050478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fb4ba-eb22-4bbc-aa2a-bb93d93e3a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.062797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fb4ba-eb22-4bbc-aa2a-bb93d93e3a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:13.064266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fb4ba-eb22-4bbc-aa2a-bb93d93e3a5d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ce5fb4ba-eb22-4bbc-aa2a-bb93d93e3a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:13.083435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:13.084407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:13.085330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:13.085330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:13.085330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:13.085330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:13.086241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 516/1022] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:13.091412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:13.202793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a716c1-c771-4c20-843c-20478128ab0d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:13.206703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc011fa-7b20-4102-bda9-ec51d81ec527 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.206989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc011fa-7b20-4102-bda9-ec51d81ec527 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.207265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc011fa-7b20-4102-bda9-ec51d81ec527 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.208765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 517/1023] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:13.213890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab42e1-8365-44c9-974e-7429e6243bfb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.215002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab42e1-8365-44c9-974e-7429e6243bfb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.215246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab42e1-8365-44c9-974e-7429e6243bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.232224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a3ab42e1-8365-44c9-974e-7429e6243bfb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:13.233426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a3ab42e1-8365-44c9-974e-7429e6243bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:13.245602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:13.246574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.247132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.247610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.248528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:13.249016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:13.250596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:13.264394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 507/1024] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:13.270053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:13.296925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:13.326458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 518/1025] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:13 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:13.349570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab42e1-8365-44c9-974e-7429e6243bfb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:13.399040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e176e2-467a-4124-8ce2-6fe72b71f467 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:13.443817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:13.444908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.445810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.445810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.455466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:13.456833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:13.466985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab42e1-8365-44c9-974e-7429e6243bfb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:01:13.474000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:13.476128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:13.478717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 508/1026] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:01:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:13.481097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:13.483409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:13.525166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:13.526028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.526353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.526647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.527359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:13.529363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:13.550278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 519/1027] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:01:13 2022] POST /identity/v3/services => generated 242 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:01:13.580524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:13.611669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7e414-49bd-4701-b7e2-17ac848ce537 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:13.665940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189b21d-3ffd-466f-ae5f-097b894fdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:13.666674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189b21d-3ffd-466f-ae5f-097b894fdaab None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.667109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189b21d-3ffd-466f-ae5f-097b894fdaab None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.667230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189b21d-3ffd-466f-ae5f-097b894fdaab None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.668077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189b21d-3ffd-466f-ae5f-097b894fdaab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:13.668391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189b21d-3ffd-466f-ae5f-097b894fdaab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:13.669900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189b21d-3ffd-466f-ae5f-097b894fdaab None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:13.695136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 509/1028] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:01:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:13.696742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:13.805048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade99e4c-2a9a-48e0-970c-e0b6c0f9b7b4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.805335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade99e4c-2a9a-48e0-970c-e0b6c0f9b7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.805614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade99e4c-2a9a-48e0-970c-e0b6c0f9b7b4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.807215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 510/1029] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:13.813045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc90c-e6fe-47ec-8594-cfeafe3aa33f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.813337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc90c-e6fe-47ec-8594-cfeafe3aa33f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.813621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc90c-e6fe-47ec-8594-cfeafe3aa33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.825730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9ef54-aa0b-4514-be9f-50a4eb088226 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:13.830888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8abdc90c-e6fe-47ec-8594-cfeafe3aa33f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:13.832115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8abdc90c-e6fe-47ec-8594-cfeafe3aa33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:13.869314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:13.871110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:13.871399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:13.871681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:13.907211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 511/1030] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:13.915494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:13.932818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdc90c-e6fe-47ec-8594-cfeafe3aa33f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:13.960051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:13.961815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:14.013065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:14.055350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdc90c-e6fe-47ec-8594-cfeafe3aa33f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:14.075085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 520/1031] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:01:14.084017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:14.100815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:14.102114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:14.102430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:14.102712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:14.104381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:14.106741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:14.108592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 512/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:14.114224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:14.165344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:14.218373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b9560-4af2-4cb9-8c63-03ba5fb25881 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:14.228602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f228-bc08-4837-a96e-1f62b2cbeb18 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:14.259990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:14.261706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:14.262150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:14.262601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:14.266234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:14.266923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:14.267213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:14.267491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:14.268212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:14.269662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:14.275069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:14.276989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:14.277433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:14.293391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 513/1033] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:01:14 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:14.300825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:14.302098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:14.303376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:14.303376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:14.303376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:14.303376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:14.303376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 521/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:14.308218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:14.429345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0bd3-c003-4d30-a244-05fb2e2e532c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:14.470154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:14.471242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:14.471743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:14.472022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:14.472756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:14.473063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:14.474486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:14.490658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 514/1035] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:14.497408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:14.603558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd486aec-e7b6-42b3-a694-11587948058e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:14.619829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:14.639588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:14.640393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:14.640676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:14.640956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:14.648397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:14.649852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:01:14.664354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:14.665263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:14.666221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 522/1036] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:14.671502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:14.724839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:14.779865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db299d4-7f9e-48d2-a645-622063ab377b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:14.825873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118fadc-8665-40ef-b7d5-b0d260757442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:14.826581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118fadc-8665-40ef-b7d5-b0d260757442 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:14.826865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118fadc-8665-40ef-b7d5-b0d260757442 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:14.827144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118fadc-8665-40ef-b7d5-b0d260757442 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:14.827952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118fadc-8665-40ef-b7d5-b0d260757442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:14.828261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118fadc-8665-40ef-b7d5-b0d260757442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:14.829705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118fadc-8665-40ef-b7d5-b0d260757442 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:14.844451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 515/1037] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:14.850785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:14.968516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b329-f891-40c9-b6ba-644cfb51e7e3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:15.012188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7dfe3-b6a1-4ebb-b70d-556e39b82802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:15.012864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7dfe3-b6a1-4ebb-b70d-556e39b82802 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:15.013149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7dfe3-b6a1-4ebb-b70d-556e39b82802 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:15.013430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7dfe3-b6a1-4ebb-b70d-556e39b82802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:15.014313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7dfe3-b6a1-4ebb-b70d-556e39b82802 None admin] RBAC: Adding query filter params (role.id=2af13917f2cc4f6086e0f8dc5f51a529, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=6d604a09f0e04fd2ac41f31a4e13e166) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:15.014632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7dfe3-b6a1-4ebb-b70d-556e39b82802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:15.016075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7dfe3-b6a1-4ebb-b70d-556e39b82802 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:15.029906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 523/1038] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:14 2022] GET /identity/v3/role_assignments?user.id=6d604a09f0e04fd2ac41f31a4e13e166&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=2af13917f2cc4f6086e0f8dc5f51a529 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:15.675418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58added8-cbcd-4c77-b088-6160820ae379 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:15.675968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58added8-cbcd-4c77-b088-6160820ae379 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:15.675968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58added8-cbcd-4c77-b088-6160820ae379 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:15.677357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 516/1039] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:15.683514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d67e-54b6-4b3f-866a-de3d96890d83 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:15.683947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d67e-54b6-4b3f-866a-de3d96890d83 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:15.684159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d67e-54b6-4b3f-866a-de3d96890d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:15.701964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c677d67e-54b6-4b3f-866a-de3d96890d83 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:15.703221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c677d67e-54b6-4b3f-866a-de3d96890d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:15.738822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:15.774530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 524/1040] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:15.797251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58added8-cbcd-4c77-b088-6160820ae379 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:15.928514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58added8-cbcd-4c77-b088-6160820ae379 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:15.940763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:15.969684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:15.970518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:15.970804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:15.971081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] PATH_INFO: `/v3/services/image` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:15.971746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:15.973130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:15.986559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:15.987670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:15.988517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:15.990069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 517/1041] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jul 21 10:01:15 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:15.994461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d67e-54b6-4b3f-866a-de3d96890d83 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:16.098631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d67e-54b6-4b3f-866a-de3d96890d83 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:16.134096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:16.134797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:16.135125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:16.135436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:16.136195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] RBAC: Adding query filter params (name=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:16.136505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:16.137883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:16.143215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 525/1042] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:16.148687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:16.261567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8ad0c-3e5a-445e-bc79-4b9f9226a063 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:16.298770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:16.299449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:16.299731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:16.300005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:16.300721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] RBAC: Adding query filter params (type=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:16.301028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:16.302443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:16.312158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 518/1043] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:16.313402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:16.349760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:16.418439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26b834-2af7-4a0b-85ec-f9484298ed55 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:16.452704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b0763-f443-4dec-99f2-d44e37568c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:16.453368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b0763-f443-4dec-99f2-d44e37568c25 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:16.453655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b0763-f443-4dec-99f2-d44e37568c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:16.453934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b0763-f443-4dec-99f2-d44e37568c25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:16.454764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b0763-f443-4dec-99f2-d44e37568c25 None admin] RBAC: Adding query filter params (interface=public, service_id=3e814eb6323e48c099d74d9450113598, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:16.455079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b0763-f443-4dec-99f2-d44e37568c25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:16.456453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b0763-f443-4dec-99f2-d44e37568c25 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:16.466246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 526/1044] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:01:16 2022] GET /identity/v3/endpoints?service_id=3e814eb6323e48c099d74d9450113598&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:16.471454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:16.519536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:16.583944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d97fc5-65eb-4182-88ae-826e4d881a45 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:16.618250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f3822-6c0c-4ddd-9d4e-9733306a3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:16.618871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3822-6c0c-4ddd-9d4e-9733306a3d99 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:16.619202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3822-6c0c-4ddd-9d4e-9733306a3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:16.619486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3822-6c0c-4ddd-9d4e-9733306a3d99 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:16.620724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f3822-6c0c-4ddd-9d4e-9733306a3d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:16.622106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f3822-6c0c-4ddd-9d4e-9733306a3d99 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:16.634301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 519/1045] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:01:16 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:01:16.834388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ddfc-7c26-4805-9150-97fe08137aa7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:16.834942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ddfc-7c26-4805-9150-97fe08137aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:16.835366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ddfc-7c26-4805-9150-97fe08137aa7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:16.837915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 527/1046] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:16.845791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056932b5-7c95-44fa-9510-b97b3164637a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:16.846513 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056932b5-7c95-44fa-9510-b97b3164637a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:16.847028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056932b5-7c95-44fa-9510-b97b3164637a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:16.875505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-056932b5-7c95-44fa-9510-b97b3164637a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:16.877452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-056932b5-7c95-44fa-9510-b97b3164637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:16.962306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 520/1047] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:16.983374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ddfc-7c26-4805-9150-97fe08137aa7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.147396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:17.153229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ddfc-7c26-4805-9150-97fe08137aa7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:17.190937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7c6bf-be35-455f-afc0-893edfc5a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:17.191750 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7c6bf-be35-455f-afc0-893edfc5a6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.192037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7c6bf-be35-455f-afc0-893edfc5a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.192316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7c6bf-be35-455f-afc0-893edfc5a6d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.212609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7c6bf-be35-455f-afc0-893edfc5a6d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-07c7c6bf-be35-455f-afc0-893edfc5a6d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:17.221267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:17.222289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:17.229542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 528/1048] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:17.230293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056932b5-7c95-44fa-9510-b97b3164637a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.235007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97210fb0-91a7-4b83-8015-12188bb0504e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.235295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97210fb0-91a7-4b83-8015-12188bb0504e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.235577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97210fb0-91a7-4b83-8015-12188bb0504e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.237136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 529/1049] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:17.242090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178103-9a63-4a38-b9eb-dded45cb62bd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.242412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178103-9a63-4a38-b9eb-dded45cb62bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.242693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178103-9a63-4a38-b9eb-dded45cb62bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.260163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-44178103-9a63-4a38-b9eb-dded45cb62bd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:17.262020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44178103-9a63-4a38-b9eb-dded45cb62bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:17.264623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:17.332568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 530/1050] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:17.351198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056932b5-7c95-44fa-9510-b97b3164637a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:17.354989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178103-9a63-4a38-b9eb-dded45cb62bd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.391019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:17.391703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.391980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.392247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.393008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:17.393312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:17.394721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:17.409300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 521/1051] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:17.410859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.453453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:17.469458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178103-9a63-4a38-b9eb-dded45cb62bd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:17.509740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:17.510617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.510898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.511345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.513647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:17.521820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ba28-53b1-4be9-a272-b57035b2e816 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:17.522613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:17.531036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:17.532015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:17.532838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 531/1052] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:17.538377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.560617 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:17.561505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.561788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.562064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] PATH_INFO: `/v3/users/710c51a93b0342d3b4766c17f690afd7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.581357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=710c51a93b0342d3b4766c17f690afd7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:17.582869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:17.585610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 522/1053] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/users/710c51a93b0342d3b4766c17f690afd7 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:17.590990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.653859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953338-3d20-48ee-9b7e-c600357460cf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:17.689737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:17.690357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.690640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.690920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.691672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:17.691980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:17.693356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:17.696910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac90d-5013-43e5-a781-75ce5c6cb8f4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:17.706973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 532/1054] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:17.708049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.722360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:17.740067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:17.740728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.741009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.741280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.766556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:17.819174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:17.820632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:17.827888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968249b2-f661-4162-a6c7-8f9889173124 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:17.867726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:17.868539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:17.868817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:17.869090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:17.881856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:17.883495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:17.902158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:17.903152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:17.904311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:17.904311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:17.904311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:17.904311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:17.908639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 533/1055] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:17.909502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.938553 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 523/1056] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:01:17.939587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:17.977270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:17.998374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:18.021873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b916-915e-445c-9deb-1cb9c9a123e8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.052890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7111c1-4aac-44d1-bc43-206d1aa9398c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.058940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.059633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.059914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.060187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.060948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:18.061264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.062736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.076298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 534/1057] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:18.082199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:18.092480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.093358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.093637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.093906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.095141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] RBAC: Authorizing `identity:get_project(project_id=c27a46f611364b70a0fb745c245a0b49)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.096637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.098470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 524/1058] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:17 2022] GET /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:18.104471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:18.189535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067a5e-2855-4fe1-aad4-7423d3101de1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.206273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7d8eb-c2a3-4172-9b7a-b857e6bcd227 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.213464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:18.227011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.227876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.228203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:18.228774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.229053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.237369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.238881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.243608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.244270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.244550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.244822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.245689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=c27a46f611364b70a0fb745c245a0b49, user.id=710c51a93b0342d3b4766c17f690afd7) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:18.246003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.247456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.258203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 525/1059] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:18 2022] GET /identity/v3/role_assignments?user.id=710c51a93b0342d3b4766c17f690afd7&scope.project.id=c27a46f611364b70a0fb745c245a0b49&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:01:18.258393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:18.259270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:18.260183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 535/1060] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:01:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:18.271562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:18.388895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0f4c7-f7c8-4606-9fb8-7fff13031efc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.431814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.432512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.432916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.433087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.433911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:18.434267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.435770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.454754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 526/1061] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:01:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:18.460890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:18.577819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad999f-beb1-4f87-8455-f5ae0e48f6d4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.614517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f6f99-9f12-4426-98e2-420740c22ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.615324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f6f99-9f12-4426-98e2-420740c22ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.615606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f6f99-9f12-4426-98e2-420740c22ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.615880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f6f99-9f12-4426-98e2-420740c22ae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.626901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f6f99-9f12-4426-98e2-420740c22ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.628347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f6f99-9f12-4426-98e2-420740c22ae7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2f5f6f99-9f12-4426-98e2-420740c22ae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:18.645687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:18.646851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:18.647739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:18.647739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:18.647739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:18.647739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:18.650237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 536/1062] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:18.653126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:18.697722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:18.719712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49548cf-b3aa-4b7d-94d7-287769573a38 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.719998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49548cf-b3aa-4b7d-94d7-287769573a38 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.720271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49548cf-b3aa-4b7d-94d7-287769573a38 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.721783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 537/1063] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:18.726889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0689-0c5b-4fda-965a-309848db0799 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.727174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0689-0c5b-4fda-965a-309848db0799 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.727450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0689-0c5b-4fda-965a-309848db0799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.747835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2a1e0689-0c5b-4fda-965a-309848db0799 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:18.748968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a1e0689-0c5b-4fda-965a-309848db0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:18.764854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6fa4-b480-4851-9c71-dab32a178673 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.788379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:18.804328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.805005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.805284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.805590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.806498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:18.806683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.808066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.822032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 527/1064] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:18.827845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:18.840283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 538/1065] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:18.863505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e0689-0c5b-4fda-965a-309848db0799 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:18.934652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae3783-3b52-4c24-837a-6e7e5b970443 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.936311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:18.971135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:18.971943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:18.972227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:18.972503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:18.973738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e0689-0c5b-4fda-965a-309848db0799 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:18.979500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:18.981473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:01:18.997006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:18.997989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:18.999479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 528/1066] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:19.003954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:19.011975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:19.012781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:19.013068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:19.013350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] PATH_INFO: `/v3/services/image` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:19.014018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:19.015436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:19.027344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:19.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:19.029351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 539/1067] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jul 21 10:01:18 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:19.035382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:19.066445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:19.116042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509ae2-0ecd-4588-8c84-a6cae10308d0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:19.144279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb68b93-d4e1-4eb8-b5a0-9a035d593423 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:19.154130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:19.154834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:19.155118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:19.155395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:19.156196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:19.156506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:19.157951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:19.178233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 529/1068] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:19.180152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:19.196630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:19.197424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:19.197709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:19.198051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:19.198922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] RBAC: Adding query filter params (name=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:19.199208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:19.200652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:19.211121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 540/1069] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:19.211641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:19.212054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:19.306737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c84f52-2d54-40b5-afac-1299e6a5aa64 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:19.348334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:19.358224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:19.359400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:19.359868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:19.360340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/6d604a09f0e04fd2ac41f31a4e13e166/roles/2af13917f2cc4f6086e0f8dc5f51a529` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:19.362463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c80c3-475a-4eb5-aa92-a86df7122c2f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:19.363042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=6d604a09f0e04fd2ac41f31a4e13e166, role_id=2af13917f2cc4f6086e0f8dc5f51a529)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:19.364756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:19.389002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 530/1070] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:01:19 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/6d604a09f0e04fd2ac41f31a4e13e166/roles/2af13917f2cc4f6086e0f8dc5f51a529 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:01:19.416503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e57a-e6ff-4750-86a5-72ab8b24770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:19.418271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e57a-e6ff-4750-86a5-72ab8b24770f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:19.418635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e57a-e6ff-4750-86a5-72ab8b24770f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:19.419015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e57a-e6ff-4750-86a5-72ab8b24770f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:19.419895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e57a-e6ff-4750-86a5-72ab8b24770f None admin] RBAC: Adding query filter params (type=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:19.420307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e57a-e6ff-4750-86a5-72ab8b24770f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:19.421885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e57a-e6ff-4750-86a5-72ab8b24770f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:19.431148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 541/1071] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:19.437035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:19.548731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:19.572055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697594e-2094-48de-83d7-fe3a1197b51c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:19.607748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20473c-7321-4693-bf0b-831841c89012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:19.608420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20473c-7321-4693-bf0b-831841c89012 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:19.608699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20473c-7321-4693-bf0b-831841c89012 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:19.608969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20473c-7321-4693-bf0b-831841c89012 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:19.609718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20473c-7321-4693-bf0b-831841c89012 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:19.611125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20473c-7321-4693-bf0b-831841c89012 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:19.631002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 531/1072] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:01:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:01:20.376894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf093-2435-4c9a-a5ce-c78ecab23186 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:20.377480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf093-2435-4c9a-a5ce-c78ecab23186 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:20.377480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf093-2435-4c9a-a5ce-c78ecab23186 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:20.379037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 542/1073] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:20.384416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78563de-276a-425e-8e47-5c2ae9c07041 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:20.384881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78563de-276a-425e-8e47-5c2ae9c07041 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:20.384982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78563de-276a-425e-8e47-5c2ae9c07041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:20.406343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d78563de-276a-425e-8e47-5c2ae9c07041 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:20.407727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d78563de-276a-425e-8e47-5c2ae9c07041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:20.520603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 532/1074] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:20.543833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf093-2435-4c9a-a5ce-c78ecab23186 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:20.669097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf093-2435-4c9a-a5ce-c78ecab23186 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:20.739074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:20.740126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:20.740600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:20.741083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:20.759568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:20.775588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:20.777307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:20.778137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:20.782585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 543/1075] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:20.784026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78563de-276a-425e-8e47-5c2ae9c07041 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:20.858762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:20.900837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78563de-276a-425e-8e47-5c2ae9c07041 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:20.936068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:20.936641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:20.936919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:20.937186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:20.937940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:20.938267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:20.939637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:20.948600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 533/1076] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:20.954575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:20.974733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:21.061241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230da372-464e-4ff4-9acf-cc48e7c37927 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:21.101150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:21.102139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.102462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.102736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] PATH_INFO: `/v3/users/710c51a93b0342d3b4766c17f690afd7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.103997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] RBAC: Authorizing `identity:get_user(user_id=710c51a93b0342d3b4766c17f690afd7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:21.106041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:21.108089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 544/1077] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:20 2022] GET /identity/v3/users/710c51a93b0342d3b4766c17f690afd7 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:21.114621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:21.223820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16343108-948b-48a2-bf2e-4e79fd1e4baa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:21.257218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:21.268537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd34477-927f-4a6f-9d86-009ce5641707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:21.269429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34477-927f-4a6f-9d86-009ce5641707 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.269703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34477-927f-4a6f-9d86-009ce5641707 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.269984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34477-927f-4a6f-9d86-009ce5641707 None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.271236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd34477-927f-4a6f-9d86-009ce5641707 None admin] RBAC: Authorizing `identity:get_project(project_id=c27a46f611364b70a0fb745c245a0b49)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:21.272681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd34477-927f-4a6f-9d86-009ce5641707 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:21.280003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 534/1078] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:21 2022] GET /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:21.281548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:21.394577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:21.415187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fd906-4d38-41a7-8ea2-8804bc8b7c22 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:21.453179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941deed-b983-4483-a0c7-d2e37315883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:21.454088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941deed-b983-4483-a0c7-d2e37315883a None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.454403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941deed-b983-4483-a0c7-d2e37315883a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.454696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941deed-b983-4483-a0c7-d2e37315883a None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49/users/710c51a93b0342d3b4766c17f690afd7/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.456703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941deed-b983-4483-a0c7-d2e37315883a None admin] RBAC: Authorizing `identity:create_grant(project_id=c27a46f611364b70a0fb745c245a0b49, user_id=710c51a93b0342d3b4766c17f690afd7, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:21.458347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941deed-b983-4483-a0c7-d2e37315883a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:21.476134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 545/1079] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:01:21 2022] PUT /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49/users/710c51a93b0342d3b4766c17f690afd7/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:01:21.500096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749192d-e906-4c95-a823-7524dd24a739 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.500640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749192d-e906-4c95-a823-7524dd24a739 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.500640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749192d-e906-4c95-a823-7524dd24a739 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.502320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 535/1080] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:21.508802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37836a-93c5-4c1f-90c1-7ace37760ebe None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.509111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37836a-93c5-4c1f-90c1-7ace37760ebe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.509535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37836a-93c5-4c1f-90c1-7ace37760ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.527658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ca37836a-93c5-4c1f-90c1-7ace37760ebe None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:21.528972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ca37836a-93c5-4c1f-90c1-7ace37760ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:21.607259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 546/1081] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:21.631498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749192d-e906-4c95-a823-7524dd24a739 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:21.724516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5cea-a5c5-4c29-b0a8-25f7c0d8bdbe None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.724838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5cea-a5c5-4c29-b0a8-25f7c0d8bdbe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.725082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5cea-a5c5-4c29-b0a8-25f7c0d8bdbe None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.726694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 547/1082] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:21.732613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468226d-5e2b-45c4-b814-c9687bbdc13b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.732897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468226d-5e2b-45c4-b814-c9687bbdc13b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.733175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468226d-5e2b-45c4-b814-c9687bbdc13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.751380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f468226d-5e2b-45c4-b814-c9687bbdc13b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:21.752586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749192d-e906-4c95-a823-7524dd24a739 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:21.752810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f468226d-5e2b-45c4-b814-c9687bbdc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:21.789776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:21.790646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.790921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.791196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.803837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:21.812189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:21.813153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:21.813996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 536/1083] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jul 21 10:01:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:21.819306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:21.834202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 548/1084] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:21.858081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468226d-5e2b-45c4-b814-c9687bbdc13b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:21.861838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:21.889138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:21.945631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e76d4-d337-4b3c-b524-f1d0a96399ca None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:21.984355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468226d-5e2b-45c4-b814-c9687bbdc13b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:21.990036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:21.990749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:21.991040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:21.991315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:21.992078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:21.992773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:21.993764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.003005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 537/1085] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jul 21 10:01:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:22.008392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:22.022262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:22.022937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:22.023225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:22.023506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:22.119739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:22.121225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.124229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:22.140749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d061fba-c779-4fd4-8d67-1ea2f6da9203 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:22.165041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:22.184490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:22.185269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:22.185550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:22.185823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:22.197914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:22.199935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:22.220933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:22.221948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:22.227773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:22.227773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:22.227773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:22.227773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:22.227773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 538/1086] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:22.228051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:22.238248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 549/1087] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:01:22.243918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:22.337515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321d01-bfbb-45cd-b3f0-8470a314e9a8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:22.350481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e59f0c-c082-4cc5-9e41-e2fd1f487d4f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:22.352818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:22.377146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:22.377825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:22.378109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:22.378416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:22.379150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:22.379463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:22.380853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.387963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:22.388876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:22.389158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:22.389428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:22.398094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 539/1088] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:22.399157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:22.402431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:22.404019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:22.426794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:22.428084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:22.429092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:22.429092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:22.429092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:22.429092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:22.429092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 550/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:22.434554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:22.437748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:22.518596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177b600-ea0b-4079-8aad-df4c114b5ff2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:22.554802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be81273-3e4a-465a-8f00-16c49376297f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:22.556715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:22.558096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:22.558486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:22.558751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:22.566560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:22.568014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:01:22.583530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:22.584530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:22.585563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 540/1090] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jul 21 10:01:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:22.590758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:22.599003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:22.599681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:22.599961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:22.600234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:22.600962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:22.601269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:22.602714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.616269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 551/1091] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:22.719612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:22.738467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454871-32f3-4d8f-ac16-5d0b32377b88 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:22.783740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:22.784336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:22.784613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:22.784879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:22.785744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:22.786048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:22.787536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:22.813419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 541/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jul 21 10:01:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:22.821118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:22.845391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:22.972145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e91b8c-4e31-42c5-8393-e7789eacf56c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:23.008487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:23.009150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.009437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.009717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.120626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:23.123336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:23.144275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:23.240275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 552/1093] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:01:23.241613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:23.351277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d471a-3b21-419b-9ef3-94ad2c5c3221 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:23.387117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1842a-1fe9-475a-878e-4e0b3f848061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:23.387906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1842a-1fe9-475a-878e-4e0b3f848061 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.388190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1842a-1fe9-475a-878e-4e0b3f848061 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.388463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1842a-1fe9-475a-878e-4e0b3f848061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.398911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1842a-1fe9-475a-878e-4e0b3f848061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:23.400442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1842a-1fe9-475a-878e-4e0b3f848061 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:23.407739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-12f1842a-1fe9-475a-878e-4e0b3f848061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:23.419852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:23.421050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:23.421994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:01:23.421994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:23.421994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:01:23.421994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:23.421994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 542/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:23.427181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:23.534775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab83747-f63f-4b59-a5eb-e322ade01b16 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:23.552725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:23.571012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6399-85e5-4175-8e9b-7d23affc66e0 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.571534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6399-85e5-4175-8e9b-7d23affc66e0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.571534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6399-85e5-4175-8e9b-7d23affc66e0 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.572960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 543/1095] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:01:23.578349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8674-db58-433d-acda-b042d8e2a3f5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.578664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8674-db58-433d-acda-b042d8e2a3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.578793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:23.578948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8674-db58-433d-acda-b042d8e2a3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.579385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.579668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.579944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.580683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:23.580988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:23.582404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:23.594903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 553/1096] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:23.596455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-906a8674-db58-433d-acda-b042d8e2a3f5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:23.597658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-906a8674-db58-433d-acda-b042d8e2a3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:23.601113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:23.674994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 544/1097] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:23.698417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8674-db58-433d-acda-b042d8e2a3f5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:23.708389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e2cd7-f2dc-4cf0-ba03-daf34ab23d0a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:23.742295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:23.743108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.743400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.743680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.751150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:23.752624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:01:23.767049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:23.767965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:23.769033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 554/1098] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:23.774771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:23.801138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8674-db58-433d-acda-b042d8e2a3f5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:23.809543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:23.827967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:23.836430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:23.837310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.837661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.838006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.849306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:23.857072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:23.858031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:23.858898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 545/1099] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:01:23.864198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:23.876633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d827e-cda4-4670-8f55-dcdb4bf0c72f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:23.912418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:23.913082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:23.913368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:23.913645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:23.914473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:23.914787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:23.916240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:23.933111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 555/1100] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:23.934105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:23.964870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec6456-b48a-42ad-b406-8b8f654646c6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:24.002449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:24.003124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:24.003410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:24.003682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:24.004449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:24.004753 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:24.006145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:24.015505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 546/1101] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:24.021386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:24.037301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:24.046598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea31c6-0cb2-441a-9b1a-bc0d939baaec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:24.079478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:24.087724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:24.088414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:24.088692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:24.088968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:24.090067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] RBAC: Adding query filter params (role.id=2af13917f2cc4f6086e0f8dc5f51a529, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=6d604a09f0e04fd2ac41f31a4e13e166) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:24.090457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:24.091852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:24.097932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 556/1102] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:23 2022] GET /identity/v3/role_assignments?user.id=6d604a09f0e04fd2ac41f31a4e13e166&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=2af13917f2cc4f6086e0f8dc5f51a529 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:24.164290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c901aa-edc5-4186-aa37-d2156ff75c19 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:24.203399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:24.204219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:24.204499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:24.204773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] PATH_INFO: `/v3/users/710c51a93b0342d3b4766c17f690afd7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:24.206096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] RBAC: Authorizing `identity:get_user(user_id=710c51a93b0342d3b4766c17f690afd7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:24.207584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:24.209311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 547/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:24 2022] GET /identity/v3/users/710c51a93b0342d3b4766c17f690afd7 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:01:24.215742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:24.329976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b585a7-3470-41a2-b93a-45d78b9682cd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:24.367624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:24.370867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:24.370867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:24.370867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:24.398108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:24.441272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:24.442762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:24.546921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 557/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:01:24.553114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:24.656686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040eb9-f2b1-49e3-b654-08d99ad9c8ce None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:24.675344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:24.695538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983cf83-a6da-4c61-b440-172559b684de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:24.696422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cf83-a6da-4c61-b440-172559b684de None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:24.696705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cf83-a6da-4c61-b440-172559b684de None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:24.696976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cf83-a6da-4c61-b440-172559b684de None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:24.698233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983cf83-a6da-4c61-b440-172559b684de None admin] RBAC: Authorizing `identity:get_project(project_id=c27a46f611364b70a0fb745c245a0b49)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:24.699812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983cf83-a6da-4c61-b440-172559b684de None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:24.701701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 548/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:24 2022] GET /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:24.707696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:24.776452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:24.819695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fec846-f1cf-4ec6-a7c8-20f0c570e0f4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:24.855141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3d66a-2a4a-466c-9a50-e89376083f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:24.855813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d66a-2a4a-466c-9a50-e89376083f0e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:24.856092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d66a-2a4a-466c-9a50-e89376083f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:24.856371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d66a-2a4a-466c-9a50-e89376083f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:24.857217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d66a-2a4a-466c-9a50-e89376083f0e None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=c27a46f611364b70a0fb745c245a0b49, user.id=710c51a93b0342d3b4766c17f690afd7) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:24.857532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d66a-2a4a-466c-9a50-e89376083f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:24.858987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d66a-2a4a-466c-9a50-e89376083f0e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:24.865570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 558/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:24 2022] GET /identity/v3/role_assignments?user.id=710c51a93b0342d3b4766c17f690afd7&scope.project.id=c27a46f611364b70a0fb745c245a0b49&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:26.924323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c82f9-b725-4d4d-a12c-c8cc89fc0157 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:26.924854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c82f9-b725-4d4d-a12c-c8cc89fc0157 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:26.924854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c82f9-b725-4d4d-a12c-c8cc89fc0157 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:26.926254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 549/1107] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:26.931483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62bcc3-9a86-436a-ab2a-172338fc5962 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:26.931878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62bcc3-9a86-436a-ab2a-172338fc5962 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:26.932048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62bcc3-9a86-436a-ab2a-172338fc5962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:26.948424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ba62bcc3-9a86-436a-ab2a-172338fc5962 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:26.949626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ba62bcc3-9a86-436a-ab2a-172338fc5962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:27.015747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 559/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:27.040605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c82f9-b725-4d4d-a12c-c8cc89fc0157 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:27.146368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c82f9-b725-4d4d-a12c-c8cc89fc0157 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:27.178224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475215a6-0056-4cf3-bfb1-1ee294a410d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:27.179043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475215a6-0056-4cf3-bfb1-1ee294a410d4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:27.179324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475215a6-0056-4cf3-bfb1-1ee294a410d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:27.179707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475215a6-0056-4cf3-bfb1-1ee294a410d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:27.180876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475215a6-0056-4cf3-bfb1-1ee294a410d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:27.182852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475215a6-0056-4cf3-bfb1-1ee294a410d4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:27.184477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 550/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:27.190360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62bcc3-9a86-436a-ab2a-172338fc5962 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:27.243950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:27.286938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62bcc3-9a86-436a-ab2a-172338fc5962 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:27.318927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4869e-8a06-4c47-9b1f-1622e34e8919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:27.319589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4869e-8a06-4c47-9b1f-1622e34e8919 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:27.319873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4869e-8a06-4c47-9b1f-1622e34e8919 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:27.320147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4869e-8a06-4c47-9b1f-1622e34e8919 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:27.320851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4869e-8a06-4c47-9b1f-1622e34e8919 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:27.322304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4869e-8a06-4c47-9b1f-1622e34e8919 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:27.341775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 560/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:01:27 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:29.412635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634602b4-30e9-4e21-a27b-839f29ebac27 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:29.413169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634602b4-30e9-4e21-a27b-839f29ebac27 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:29.413169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634602b4-30e9-4e21-a27b-839f29ebac27 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:29.414585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 551/1111] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:29.420231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911923f-3de1-43c0-950f-c47ae6c21cdf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:29.420670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911923f-3de1-43c0-950f-c47ae6c21cdf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:29.420797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911923f-3de1-43c0-950f-c47ae6c21cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:29.437786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f911923f-3de1-43c0-950f-c47ae6c21cdf None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:29.439046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f911923f-3de1-43c0-950f-c47ae6c21cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:29.508952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 561/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:29.533317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634602b4-30e9-4e21-a27b-839f29ebac27 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:29.595682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:29.640456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634602b4-30e9-4e21-a27b-839f29ebac27 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:29.673497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:29.674385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:29.674669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:29.674946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] PATH_INFO: `/v3/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:29.676417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] RBAC: Authorizing `identity:get_role(role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:29.677802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:29.679230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 552/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:29 2022] GET /identity/v3/roles/de96e843cd68485785aad1355cbf0342 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:29.685046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911923f-3de1-43c0-950f-c47ae6c21cdf None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:29.727187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:29.786187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911923f-3de1-43c0-950f-c47ae6c21cdf None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:29.819128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:29.820004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:29.820290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:29.820571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] PATH_INFO: `/v3/users/f833e9a7039c4e619df27e6115b763d7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:29.834249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] RBAC: Authorizing `identity:get_user(user_id=f833e9a7039c4e619df27e6115b763d7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:29.835706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:29.837384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 562/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:29 2022] GET /identity/v3/users/f833e9a7039c4e619df27e6115b763d7 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:29.844098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:29.943315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db154a-fb92-4a62-be0f-ebaaa34ab470 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:29.965493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:29.977133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:29.977785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:29.978067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:29.978379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:30.044316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:30.046089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:30.148909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 553/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:01:30.156824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:30.253185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:30.257243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab351e2-05e7-4a9b-8dda-537492e7ddd6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:30.290960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5dee2-8677-4f1a-99a4-3c6f9bc117c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:30.292315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dee2-8677-4f1a-99a4-3c6f9bc117c3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:30.292594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dee2-8677-4f1a-99a4-3c6f9bc117c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:30.292864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dee2-8677-4f1a-99a4-3c6f9bc117c3 None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:30.294073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5dee2-8677-4f1a-99a4-3c6f9bc117c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c27a46f611364b70a0fb745c245a0b49)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:30.295563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5dee2-8677-4f1a-99a4-3c6f9bc117c3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:30.297266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 563/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:30 2022] GET /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:30.303981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:30.327559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:30.401149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0126b9-4d3f-4c69-b7af-8425739a3adb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:30.437207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c509da-8c7b-4225-a4d5-3a7cf8773ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:30.437895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c509da-8c7b-4225-a4d5-3a7cf8773ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:30.438134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c509da-8c7b-4225-a4d5-3a7cf8773ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:30.438439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c509da-8c7b-4225-a4d5-3a7cf8773ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:30.439276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c509da-8c7b-4225-a4d5-3a7cf8773ad3 None admin] RBAC: Adding query filter params (role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=c27a46f611364b70a0fb745c245a0b49, user.id=f833e9a7039c4e619df27e6115b763d7) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:30.439588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c509da-8c7b-4225-a4d5-3a7cf8773ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:30.441034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c509da-8c7b-4225-a4d5-3a7cf8773ad3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:30.446691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 554/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:30 2022] GET /identity/v3/role_assignments?user.id=f833e9a7039c4e619df27e6115b763d7&scope.project.id=c27a46f611364b70a0fb745c245a0b49&role.id=de96e843cd68485785aad1355cbf0342 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:32.445135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0588-f877-4d02-9331-2a50701c9e80 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:32.445694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0588-f877-4d02-9331-2a50701c9e80 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:32.445694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0588-f877-4d02-9331-2a50701c9e80 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:32.447063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 564/1118] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:32.452259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c46f8-6266-4604-8203-cb5d46acec77 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:32.452690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c46f8-6266-4604-8203-cb5d46acec77 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:32.452819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c46f8-6266-4604-8203-cb5d46acec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:32.469858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fa5c46f8-6266-4604-8203-cb5d46acec77 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:32.471072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fa5c46f8-6266-4604-8203-cb5d46acec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:32.536230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 555/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:32.559858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c0588-f877-4d02-9331-2a50701c9e80 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:32.657768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c0588-f877-4d02-9331-2a50701c9e80 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:32.690049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:32.690921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:32.691198 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:32.691470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] PATH_INFO: `/v3/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:32.692925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] RBAC: Authorizing `identity:get_role(role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:32.694320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:32.695719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 565/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:32 2022] GET /identity/v3/roles/de96e843cd68485785aad1355cbf0342 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:32.702052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c46f8-6266-4604-8203-cb5d46acec77 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:32.719763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:32.799310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c46f8-6266-4604-8203-cb5d46acec77 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:32.832268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:32.833133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:32.833416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:32.833690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] PATH_INFO: `/v3/users/f833e9a7039c4e619df27e6115b763d7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:32.834840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] RBAC: Authorizing `identity:get_user(user_id=f833e9a7039c4e619df27e6115b763d7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:32.836269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:32.837902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 556/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:32 2022] GET /identity/v3/users/f833e9a7039c4e619df27e6115b763d7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:32.843998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:32.877991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:32.940986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aff5e-02fd-4b12-bd25-ff2119a223e7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:32.974006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14423edc-99b3-4f38-98fa-a5902de79942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:32.974825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423edc-99b3-4f38-98fa-a5902de79942 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:32.975108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423edc-99b3-4f38-98fa-a5902de79942 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:32.975384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423edc-99b3-4f38-98fa-a5902de79942 None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:32.976566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14423edc-99b3-4f38-98fa-a5902de79942 None admin] RBAC: Authorizing `identity:get_project(project_id=c27a46f611364b70a0fb745c245a0b49)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:32.977996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14423edc-99b3-4f38-98fa-a5902de79942 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:32.980304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 566/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:32 2022] GET /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:32.986411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:33.068365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:33.083915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f528d-9164-431e-9bc3-bedbe903a519 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:33.118251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf69b5-e50b-40ce-9dfe-7a4c701d8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:33.119142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf69b5-e50b-40ce-9dfe-7a4c701d8ffd None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:33.119956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf69b5-e50b-40ce-9dfe-7a4c701d8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:33.120236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf69b5-e50b-40ce-9dfe-7a4c701d8ffd None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49/users/f833e9a7039c4e619df27e6115b763d7/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:33.122445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf69b5-e50b-40ce-9dfe-7a4c701d8ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=c27a46f611364b70a0fb745c245a0b49, user_id=f833e9a7039c4e619df27e6115b763d7, role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:33.123890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf69b5-e50b-40ce-9dfe-7a4c701d8ffd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:33.138954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 557/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:01:32 2022] PUT /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49/users/f833e9a7039c4e619df27e6115b763d7/roles/de96e843cd68485785aad1355cbf0342 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:01:35.154301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07216e-7f5c-470c-b9aa-3365e5188a4b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:35.154834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07216e-7f5c-470c-b9aa-3365e5188a4b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:35.154962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07216e-7f5c-470c-b9aa-3365e5188a4b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:35.156224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 567/1124] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:35.161576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42420463-1d4d-40e1-b05f-3a2694fc88f4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:35.161989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42420463-1d4d-40e1-b05f-3a2694fc88f4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:35.162123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42420463-1d4d-40e1-b05f-3a2694fc88f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:35.179196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-42420463-1d4d-40e1-b05f-3a2694fc88f4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:35.180392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42420463-1d4d-40e1-b05f-3a2694fc88f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:35.247774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 558/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:35.271781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07216e-7f5c-470c-b9aa-3365e5188a4b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:35.377830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07216e-7f5c-470c-b9aa-3365e5188a4b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:35.379433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:35.413469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:35.414281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:35.414567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:35.414847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] PATH_INFO: `/v3/roles/de96e843cd68485785aad1355cbf0342` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:35.416348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] RBAC: Authorizing `identity:get_role(role_id=de96e843cd68485785aad1355cbf0342)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:35.417738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:35.419160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 568/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:35 2022] GET /identity/v3/roles/de96e843cd68485785aad1355cbf0342 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:35.425024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42420463-1d4d-40e1-b05f-3a2694fc88f4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:35.500525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:35.527313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42420463-1d4d-40e1-b05f-3a2694fc88f4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:35.562769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:35.563630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:35.563906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:35.564174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] PATH_INFO: `/v3/users/f833e9a7039c4e619df27e6115b763d7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:35.565371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] RBAC: Authorizing `identity:get_user(user_id=f833e9a7039c4e619df27e6115b763d7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:35.566832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:35.568466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 559/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:35 2022] GET /identity/v3/users/f833e9a7039c4e619df27e6115b763d7 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:35.574379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:35.672858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348249c9-2fb8-46ac-9909-694788dfd1a8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:35.708520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:35.709166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:35.709454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:35.709732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:35.749993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:35.778309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:35.779757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:35.885834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 569/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:01:35.891840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:35.995072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f253-5f0c-41c2-b97f-048dd1990f0f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:36.036594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73235edd-31e3-4502-b18c-ca17c2a0bae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:36.037467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235edd-31e3-4502-b18c-ca17c2a0bae2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:36.037747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235edd-31e3-4502-b18c-ca17c2a0bae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:36.038024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235edd-31e3-4502-b18c-ca17c2a0bae2 None admin] PATH_INFO: `/v3/projects/c27a46f611364b70a0fb745c245a0b49` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:36.039253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73235edd-31e3-4502-b18c-ca17c2a0bae2 None admin] RBAC: Authorizing `identity:get_project(project_id=c27a46f611364b70a0fb745c245a0b49)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:36.040685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73235edd-31e3-4502-b18c-ca17c2a0bae2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:36.043090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 560/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:35 2022] GET /identity/v3/projects/c27a46f611364b70a0fb745c245a0b49 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:36.049402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:36.119394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:36.151039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f85704-6ebc-4328-86d5-e48e8365548f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:36.188481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842763e-8e44-4491-93e0-683215496f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:36.189178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842763e-8e44-4491-93e0-683215496f47 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:36.189425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842763e-8e44-4491-93e0-683215496f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:36.189706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842763e-8e44-4491-93e0-683215496f47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:36.190584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842763e-8e44-4491-93e0-683215496f47 None admin] RBAC: Adding query filter params (role.id=de96e843cd68485785aad1355cbf0342, scope.project.id=c27a46f611364b70a0fb745c245a0b49, user.id=f833e9a7039c4e619df27e6115b763d7) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:36.190900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842763e-8e44-4491-93e0-683215496f47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:36.192353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842763e-8e44-4491-93e0-683215496f47 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:36.199063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 570/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:36 2022] GET /identity/v3/role_assignments?user.id=f833e9a7039c4e619df27e6115b763d7&scope.project.id=c27a46f611364b70a0fb745c245a0b49&role.id=de96e843cd68485785aad1355cbf0342 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:38.254367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094d69-ad22-4a80-89ff-6a36aa28c58e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:38.254947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094d69-ad22-4a80-89ff-6a36aa28c58e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:38.254947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094d69-ad22-4a80-89ff-6a36aa28c58e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:38.256277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 561/1131] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:38.262139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe85ba9-a327-4d95-9abd-4c0047013a85 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:38.262634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe85ba9-a327-4d95-9abd-4c0047013a85 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:38.262737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe85ba9-a327-4d95-9abd-4c0047013a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:38.280312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dfe85ba9-a327-4d95-9abd-4c0047013a85 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:38.281587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dfe85ba9-a327-4d95-9abd-4c0047013a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:38.349498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 571/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:38.373348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094d69-ad22-4a80-89ff-6a36aa28c58e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:38.386508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:38.486255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094d69-ad22-4a80-89ff-6a36aa28c58e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:38.524720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6920e-4c96-4d98-8842-617d99ac4c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:38.525489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6920e-4c96-4d98-8842-617d99ac4c69 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:38.525769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6920e-4c96-4d98-8842-617d99ac4c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:38.526037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6920e-4c96-4d98-8842-617d99ac4c69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:38.527233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6920e-4c96-4d98-8842-617d99ac4c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:38.528841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6920e-4c96-4d98-8842-617d99ac4c69 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:38.530524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 562/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:38.536428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe85ba9-a327-4d95-9abd-4c0047013a85 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:38.608948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:38.647787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe85ba9-a327-4d95-9abd-4c0047013a85 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:38.683236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5806b7-9d6a-48e0-8644-edd87f7d3926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:38.683894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5806b7-9d6a-48e0-8644-edd87f7d3926 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:38.684174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5806b7-9d6a-48e0-8644-edd87f7d3926 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:38.684449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5806b7-9d6a-48e0-8644-edd87f7d3926 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:38.685277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5806b7-9d6a-48e0-8644-edd87f7d3926 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:38.686748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5806b7-9d6a-48e0-8644-edd87f7d3926 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:38.721653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 572/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:01:38 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:40.807663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5a2f3-8be5-4d7b-bf48-ca72882ef037 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:40.808207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5a2f3-8be5-4d7b-bf48-ca72882ef037 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:40.808207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5a2f3-8be5-4d7b-bf48-ca72882ef037 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:40.809565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 563/1135] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:40.815316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d4427-6b23-450d-b79c-05e1cf2a86b2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:40.815825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d4427-6b23-450d-b79c-05e1cf2a86b2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:40.815929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d4427-6b23-450d-b79c-05e1cf2a86b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:40.836718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-607d4427-6b23-450d-b79c-05e1cf2a86b2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:40.836718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-607d4427-6b23-450d-b79c-05e1cf2a86b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:40.904937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 573/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:40.929139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5a2f3-8be5-4d7b-bf48-ca72882ef037 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:41.008757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:41.040222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5a2f3-8be5-4d7b-bf48-ca72882ef037 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:41.076306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e1142-7767-4caa-83fa-b578d2182711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:41.077026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1142-7767-4caa-83fa-b578d2182711 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:41.077310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1142-7767-4caa-83fa-b578d2182711 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:41.077586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1142-7767-4caa-83fa-b578d2182711 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:41.078839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e1142-7767-4caa-83fa-b578d2182711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:41.080289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e1142-7767-4caa-83fa-b578d2182711 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:41.081991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 564/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:01:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:41.088529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d4427-6b23-450d-b79c-05e1cf2a86b2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:41.136477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:41.203698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d4427-6b23-450d-b79c-05e1cf2a86b2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:41.247001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a32b0e-39af-481c-bcdc-540c559e419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:41.247678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a32b0e-39af-481c-bcdc-540c559e419f None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:41.247968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a32b0e-39af-481c-bcdc-540c559e419f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:41.248251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a32b0e-39af-481c-bcdc-540c559e419f None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:41.248977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a32b0e-39af-481c-bcdc-540c559e419f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:41.250441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a32b0e-39af-481c-bcdc-540c559e419f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:41.272601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 574/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:01:41 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:43.390665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fc71-bfe6-454a-937a-4a65f7228f02 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:43.391320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fc71-bfe6-454a-937a-4a65f7228f02 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:43.391320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fc71-bfe6-454a-937a-4a65f7228f02 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:43.392622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 565/1139] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:43.397917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793323-7f54-4fd6-83ed-224db70e1fdd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:43.398432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793323-7f54-4fd6-83ed-224db70e1fdd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:43.398519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793323-7f54-4fd6-83ed-224db70e1fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:43.415871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7b793323-7f54-4fd6-83ed-224db70e1fdd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:43.417075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7b793323-7f54-4fd6-83ed-224db70e1fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:43.486938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 575/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:43.511752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fc71-bfe6-454a-937a-4a65f7228f02 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:43.622944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fc71-bfe6-454a-937a-4a65f7228f02 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:43.657518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:43.658251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:43.658535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:43.658807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:43.669778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:43.678313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:43.679514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:43.680458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 566/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:01:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:43.686343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b793323-7f54-4fd6-83ed-224db70e1fdd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:43.717826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:43.788455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b793323-7f54-4fd6-83ed-224db70e1fdd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:43.822716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:43.823382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:43.823668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:43.823947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:43.824718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:43.825026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:43.826432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:43.835354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 576/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:43.841745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:43.851621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:43.943267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493a4ee-dc3d-46b5-9125-3724c16065b6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:43.976260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:43.977137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:43.977423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:43.977699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] PATH_INFO: `/v3/users/ac69fe6d5e0f48d4af4c8eb023023b41` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:43.991959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] RBAC: Authorizing `identity:get_user(user_id=ac69fe6d5e0f48d4af4c8eb023023b41)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:43.993424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:43.996289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 567/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:43 2022] GET /identity/v3/users/ac69fe6d5e0f48d4af4c8eb023023b41 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:44.002143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:44.097684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:44.105085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645712e-83c4-46b4-a56f-0f05bf056abd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:44.138309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:44.138962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:44.139242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:44.139521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:44.217326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:44.218731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:44.314798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:44.323172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 577/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:01:44.329165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:44.391891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:44.429449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631e695-8c6e-424e-90fc-09b96afba967 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:44.479443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd91942-2374-4613-a4e9-2989c4e8e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:44.480262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91942-2374-4613-a4e9-2989c4e8e520 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:44.480531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91942-2374-4613-a4e9-2989c4e8e520 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:44.480804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91942-2374-4613-a4e9-2989c4e8e520 None admin] PATH_INFO: `/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:44.482035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd91942-2374-4613-a4e9-2989c4e8e520 None admin] RBAC: Authorizing `identity:get_project(project_id=dfa6a1afb6324f0084ccb94e1942e64a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:44.483527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd91942-2374-4613-a4e9-2989c4e8e520 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:44.485304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 568/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:44 2022] GET /identity/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:44.491566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:44.611119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba46f-555d-4329-a2e0-c8c91f086f71 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:44.647773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f83b2-f2d0-4125-904b-c723dc63f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:44.648498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f83b2-f2d0-4125-904b-c723dc63f336 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:44.648842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f83b2-f2d0-4125-904b-c723dc63f336 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:44.649176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f83b2-f2d0-4125-904b-c723dc63f336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:44.650066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f83b2-f2d0-4125-904b-c723dc63f336 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=dfa6a1afb6324f0084ccb94e1942e64a, user.id=ac69fe6d5e0f48d4af4c8eb023023b41) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:44.650469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f83b2-f2d0-4125-904b-c723dc63f336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:44.651957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f83b2-f2d0-4125-904b-c723dc63f336 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:44.657859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 578/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:44 2022] GET /identity/v3/role_assignments?user.id=ac69fe6d5e0f48d4af4c8eb023023b41&scope.project.id=dfa6a1afb6324f0084ccb94e1942e64a&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:46.810906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a7f5-8776-4385-b3b1-d9ac920b1aa9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:46.811479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a7f5-8776-4385-b3b1-d9ac920b1aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:46.811479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a7f5-8776-4385-b3b1-d9ac920b1aa9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:46.812840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 569/1147] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:46.819656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431a46-3a16-4212-a1ed-2227df122412 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:46.820116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431a46-3a16-4212-a1ed-2227df122412 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:46.820270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431a46-3a16-4212-a1ed-2227df122412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:46.836769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9b431a46-3a16-4212-a1ed-2227df122412 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:46.837992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b431a46-3a16-4212-a1ed-2227df122412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:46.902460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:46.919546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 579/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:46.942480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a7f5-8776-4385-b3b1-d9ac920b1aa9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:47.043586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a7f5-8776-4385-b3b1-d9ac920b1aa9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:47.075549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:47.081432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:47.082306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:47.082588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:47.082863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:47.094111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:47.101878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:47.103003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:47.104344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 570/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:47.109974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431a46-3a16-4212-a1ed-2227df122412 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:47.215862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431a46-3a16-4212-a1ed-2227df122412 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:47.250502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:47.251173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:47.251454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:47.251729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:47.252479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:47.252785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:47.254158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:47.262438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 580/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:47.268325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:47.368938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592656ad-13fa-4723-8cc7-890597e4527f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:47.403106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:47.403978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:47.404257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:47.404529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] PATH_INFO: `/v3/users/ac69fe6d5e0f48d4af4c8eb023023b41` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:47.405714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] RBAC: Authorizing `identity:get_user(user_id=ac69fe6d5e0f48d4af4c8eb023023b41)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:47.407251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:47.408913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 571/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:47 2022] GET /identity/v3/users/ac69fe6d5e0f48d4af4c8eb023023b41 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:47.414935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:47.463791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:47.514569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2970a-7315-4709-ac42-b83d2f65339b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:47.548463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcd7da-5597-4b63-8c1d-258fd3704cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:47.549352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcd7da-5597-4b63-8c1d-258fd3704cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:47.549636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcd7da-5597-4b63-8c1d-258fd3704cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:47.549913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcd7da-5597-4b63-8c1d-258fd3704cd9 None admin] PATH_INFO: `/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:47.551117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcd7da-5597-4b63-8c1d-258fd3704cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=dfa6a1afb6324f0084ccb94e1942e64a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:47.552545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcd7da-5597-4b63-8c1d-258fd3704cd9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:47.554485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 581/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:47 2022] GET /identity/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:47.560189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:47.617992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:47.658491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d9941-a7e9-4b0d-b3cb-4ab88a469201 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:47.690346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912fbd-8b03-4d7e-932a-1d40f07f16ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:47.691227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912fbd-8b03-4d7e-932a-1d40f07f16ee None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:47.691508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912fbd-8b03-4d7e-932a-1d40f07f16ee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:47.691781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912fbd-8b03-4d7e-932a-1d40f07f16ee None admin] PATH_INFO: `/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a/users/ac69fe6d5e0f48d4af4c8eb023023b41/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:47.693721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912fbd-8b03-4d7e-932a-1d40f07f16ee None admin] RBAC: Authorizing `identity:create_grant(project_id=dfa6a1afb6324f0084ccb94e1942e64a, user_id=ac69fe6d5e0f48d4af4c8eb023023b41, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:47.695176 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912fbd-8b03-4d7e-932a-1d40f07f16ee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:47.716783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 572/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:01:47 2022] PUT /identity/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a/users/ac69fe6d5e0f48d4af4c8eb023023b41/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:01:49.735278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae45e-d10f-4511-90fb-e77f9b98bdbd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:49.735809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae45e-d10f-4511-90fb-e77f9b98bdbd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:49.735895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae45e-d10f-4511-90fb-e77f9b98bdbd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:49.737274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 582/1154] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:49.742676 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16da7d-3f76-429b-b144-97a334d6b6eb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:49.743105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16da7d-3f76-429b-b144-97a334d6b6eb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:49.743232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16da7d-3f76-429b-b144-97a334d6b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:49.760337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9b16da7d-3f76-429b-b144-97a334d6b6eb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:49.761457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9b16da7d-3f76-429b-b144-97a334d6b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:49.827133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 573/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:49.850917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fae45e-d10f-4511-90fb-e77f9b98bdbd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:49.953850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fae45e-d10f-4511-90fb-e77f9b98bdbd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:49.971502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:49.988277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:49.989068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:49.989350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:49.989626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:49.999474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:01:50.007150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:50.008240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:01:50.009766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 583/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:01:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:50.015256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16da7d-3f76-429b-b144-97a334d6b6eb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:50.065398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:50.119405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16da7d-3f76-429b-b144-97a334d6b6eb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:50.157794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:50.158491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:50.158775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:50.159048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:50.159793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:50.160096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:50.161466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:50.170462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 574/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:50.176274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:50.276058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5e94-4040-49de-b4e9-beac52c5650d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:50.309712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:50.310892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:50.311175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:50.311451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] PATH_INFO: `/v3/users/ac69fe6d5e0f48d4af4c8eb023023b41` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:50.312662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] RBAC: Authorizing `identity:get_user(user_id=ac69fe6d5e0f48d4af4c8eb023023b41)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:50.314092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:50.315747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 584/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:01:50 2022] GET /identity/v3/users/ac69fe6d5e0f48d4af4c8eb023023b41 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:50.321610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:50.423214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a39df-eae0-4a1c-8832-9134d45c14cc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:50.436319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:50.457450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:50.458109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:50.458421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:50.458698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:50.532210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:50.533591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:50.631138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 575/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:01:50.637529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:50.685952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:50.742766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7096-f95e-46e4-b12f-9245ea929462 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:50.777249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9188cd-c53d-4d3d-ac04-34c26a6435bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:50.778112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9188cd-c53d-4d3d-ac04-34c26a6435bb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:50.778414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9188cd-c53d-4d3d-ac04-34c26a6435bb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:50.778690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9188cd-c53d-4d3d-ac04-34c26a6435bb None admin] PATH_INFO: `/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:50.779871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9188cd-c53d-4d3d-ac04-34c26a6435bb None admin] RBAC: Authorizing `identity:get_project(project_id=dfa6a1afb6324f0084ccb94e1942e64a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:50.781311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9188cd-c53d-4d3d-ac04-34c26a6435bb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:50.783107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 585/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:01:50 2022] GET /identity/v3/projects/dfa6a1afb6324f0084ccb94e1942e64a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:50.789915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:50.807643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:50.918420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bf89c-1cea-4449-9f9c-01c5e77fbc1d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:50.961136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22282cdf-bb95-4855-ac44-8eca28ff8914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:50.962937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282cdf-bb95-4855-ac44-8eca28ff8914 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:50.962937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282cdf-bb95-4855-ac44-8eca28ff8914 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:50.962937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282cdf-bb95-4855-ac44-8eca28ff8914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:50.963702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282cdf-bb95-4855-ac44-8eca28ff8914 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=dfa6a1afb6324f0084ccb94e1942e64a, user.id=ac69fe6d5e0f48d4af4c8eb023023b41) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:50.964013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282cdf-bb95-4855-ac44-8eca28ff8914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:50.965920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282cdf-bb95-4855-ac44-8eca28ff8914 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:50.972557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 576/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:01:50 2022] GET /identity/v3/role_assignments?user.id=ac69fe6d5e0f48d4af4c8eb023023b41&scope.project.id=dfa6a1afb6324f0084ccb94e1942e64a&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:53.012336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3416-4b04-40c1-912e-897cb721efc1 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:53.012867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3416-4b04-40c1-912e-897cb721efc1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:53.012867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3416-4b04-40c1-912e-897cb721efc1 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:53.014248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 586/1162] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:53.019389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b7cc9-0be1-475a-90a3-0bcfd9b4dff0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:53.019780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b7cc9-0be1-475a-90a3-0bcfd9b4dff0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:53.019941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b7cc9-0be1-475a-90a3-0bcfd9b4dff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:53.036803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e65b7cc9-0be1-475a-90a3-0bcfd9b4dff0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:53.037983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e65b7cc9-0be1-475a-90a3-0bcfd9b4dff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:53.102660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 577/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:53.125614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f3416-4b04-40c1-912e-897cb721efc1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:53.227401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f3416-4b04-40c1-912e-897cb721efc1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:53.242529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:53.263004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:53.263582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:53.263870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:53.264149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:53.357440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:53.358967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:53.466237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 587/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:01:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:01:53.472305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b7cc9-0be1-475a-90a3-0bcfd9b4dff0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:53.480938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:53.569160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b7cc9-0be1-475a-90a3-0bcfd9b4dff0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:53.603057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598f47c-3ee9-4b2f-ade9-b298076b6751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:53.603847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f47c-3ee9-4b2f-ade9-b298076b6751 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:53.604125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f47c-3ee9-4b2f-ade9-b298076b6751 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:53.604390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f47c-3ee9-4b2f-ade9-b298076b6751 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:53.610923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598f47c-3ee9-4b2f-ade9-b298076b6751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:53.612352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598f47c-3ee9-4b2f-ade9-b298076b6751 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a598f47c-3ee9-4b2f-ade9-b298076b6751 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:01:53.626257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:01:53.627469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:01:53.628333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 578/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:01:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:01:53.633436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:53.648417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:53.741331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527c1b-5855-4adf-8665-4718d253bd86 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:53.776618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce105a-395b-4c6e-8ce8-4b360d7064ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:53.777286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce105a-395b-4c6e-8ce8-4b360d7064ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:53.777571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce105a-395b-4c6e-8ce8-4b360d7064ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:53.777847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce105a-395b-4c6e-8ce8-4b360d7064ba None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:53.778603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce105a-395b-4c6e-8ce8-4b360d7064ba None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:01:53.778914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce105a-395b-4c6e-8ce8-4b360d7064ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:53.780288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce105a-395b-4c6e-8ce8-4b360d7064ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:53.789140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 588/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jul 21 10:01:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:55.812340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda71274-9332-4b4b-b4c0-4ebe233b181d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:55.812858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda71274-9332-4b4b-b4c0-4ebe233b181d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:55.812954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda71274-9332-4b4b-b4c0-4ebe233b181d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:55.814292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 579/1167] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:55.819355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc2914-7cf0-4a92-878d-562c9a96f5b2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:55.819803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc2914-7cf0-4a92-878d-562c9a96f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:55.819922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc2914-7cf0-4a92-878d-562c9a96f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:55.837374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0ddc2914-7cf0-4a92-878d-562c9a96f5b2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:55.838613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0ddc2914-7cf0-4a92-878d-562c9a96f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:55.902704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 589/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:01:55.925402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda71274-9332-4b4b-b4c0-4ebe233b181d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:55.990115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:56.026123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda71274-9332-4b4b-b4c0-4ebe233b181d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:56.062020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568dc3-4aa2-4790-9b23-8e8dbfa932e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:56.062852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568dc3-4aa2-4790-9b23-8e8dbfa932e2 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:56.063067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568dc3-4aa2-4790-9b23-8e8dbfa932e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:56.063335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568dc3-4aa2-4790-9b23-8e8dbfa932e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:56.064073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02568dc3-4aa2-4790-9b23-8e8dbfa932e2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:56.065435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02568dc3-4aa2-4790-9b23-8e8dbfa932e2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:56.080235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 580/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Thu Jul 21 10:01:55 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:01:58.168194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0148ef-05dd-4d62-8202-c2e54902597d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:58.168728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0148ef-05dd-4d62-8202-c2e54902597d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:58.168728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0148ef-05dd-4d62-8202-c2e54902597d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:58.170114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 590/1170] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:01:58.175384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e50f8a-b5a5-47b8-afac-84e449ce5d6d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:58.175827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e50f8a-b5a5-47b8-afac-84e449ce5d6d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:58.175928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e50f8a-b5a5-47b8-afac-84e449ce5d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:58.192298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c8e50f8a-b5a5-47b8-afac-84e449ce5d6d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:01:58.193465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c8e50f8a-b5a5-47b8-afac-84e449ce5d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:01:58.259550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 581/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:01:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:01:58.283419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0148ef-05dd-4d62-8202-c2e54902597d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:58.294424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:58.388613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0148ef-05dd-4d62-8202-c2e54902597d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:58.421461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36533-a899-4c6d-8b42-c912891b64b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:58.422281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36533-a899-4c6d-8b42-c912891b64b8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:58.422571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36533-a899-4c6d-8b42-c912891b64b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:58.422846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36533-a899-4c6d-8b42-c912891b64b8 None admin] PATH_INFO: `/v3/domains/215f670905f940a59bc59eb2c74b198a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:58.433585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36533-a899-4c6d-8b42-c912891b64b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=215f670905f940a59bc59eb2c74b198a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:58.435048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36533-a899-4c6d-8b42-c912891b64b8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:58.436705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 591/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Jul 21 10:01:58 2022] GET /identity/v3/domains/215f670905f940a59bc59eb2c74b198a => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:01:58.442752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e50f8a-b5a5-47b8-afac-84e449ce5d6d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:01:58.498952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:01:58.541634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e50f8a-b5a5-47b8-afac-84e449ce5d6d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:01:58.576829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0bf26-5582-43fd-ae4d-eb3b717fddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:01:58.577493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0bf26-5582-43fd-ae4d-eb3b717fddb3 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:01:58.577777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0bf26-5582-43fd-ae4d-eb3b717fddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:01:58.578052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0bf26-5582-43fd-ae4d-eb3b717fddb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:01:58.578804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0bf26-5582-43fd-ae4d-eb3b717fddb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:01:58.580242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0bf26-5582-43fd-ae4d-eb3b717fddb3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:01:58.605387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 582/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:01:58 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:02:00.697474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f406c-5f00-4059-8e8f-cc42a3173742 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:00.698037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f406c-5f00-4059-8e8f-cc42a3173742 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:00.698037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f406c-5f00-4059-8e8f-cc42a3173742 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:00.699427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 592/1174] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:02:00.704696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125fdc6-5547-4897-9f0b-3a0cfb76d490 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:00.705136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125fdc6-5547-4897-9f0b-3a0cfb76d490 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:00.705238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125fdc6-5547-4897-9f0b-3a0cfb76d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:00.722429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c125fdc6-5547-4897-9f0b-3a0cfb76d490 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:02:00.723595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c125fdc6-5547-4897-9f0b-3a0cfb76d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:02:00.787936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 583/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:02:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:02:00.813128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f406c-5f00-4059-8e8f-cc42a3173742 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:00.879231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:00.913072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f406c-5f00-4059-8e8f-cc42a3173742 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:00.947431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbe0a-c5c3-452e-bb2f-ae017c6ec251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:00.948292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbe0a-c5c3-452e-bb2f-ae017c6ec251 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:00.948571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbe0a-c5c3-452e-bb2f-ae017c6ec251 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:00.948841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbe0a-c5c3-452e-bb2f-ae017c6ec251 None admin] PATH_INFO: `/v3/domains/215f670905f940a59bc59eb2c74b198a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:00.950012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cbe0a-c5c3-452e-bb2f-ae017c6ec251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=215f670905f940a59bc59eb2c74b198a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:00.951469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cbe0a-c5c3-452e-bb2f-ae017c6ec251 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:00.953059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 593/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Jul 21 10:02:00 2022] GET /identity/v3/domains/215f670905f940a59bc59eb2c74b198a => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:00.958915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125fdc6-5547-4897-9f0b-3a0cfb76d490 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:00.997693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:01.058323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125fdc6-5547-4897-9f0b-3a0cfb76d490 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:01.090731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769e61a-d054-480f-a431-70a3117d5de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:01.091431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e61a-d054-480f-a431-70a3117d5de3 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:01.091713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e61a-d054-480f-a431-70a3117d5de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:01.091985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e61a-d054-480f-a431-70a3117d5de3 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:01.092687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769e61a-d054-480f-a431-70a3117d5de3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:01.094111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769e61a-d054-480f-a431-70a3117d5de3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:01.113707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 584/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:02:00 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:02:03.175668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f69b4-4288-4948-902c-e50f8cbf0579 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:03.176210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f69b4-4288-4948-902c-e50f8cbf0579 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:03.176210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f69b4-4288-4948-902c-e50f8cbf0579 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:03.177577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 594/1178] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:02:03.183496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722fb1b-c512-401a-8e2f-b8d2db899579 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:03.183930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722fb1b-c512-401a-8e2f-b8d2db899579 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:03.184054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722fb1b-c512-401a-8e2f-b8d2db899579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:03.201081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c722fb1b-c512-401a-8e2f-b8d2db899579 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:02:03.202302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c722fb1b-c512-401a-8e2f-b8d2db899579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:02:03.268588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 585/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:02:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:02:03.292480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f69b4-4288-4948-902c-e50f8cbf0579 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:03.396701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f69b4-4288-4948-902c-e50f8cbf0579 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:03.430295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:03.431538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:03.431845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:03.432101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:03.434951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:03.443815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:02:03.451568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:02:03.452672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:02:03.453520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 595/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:02:03.459481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722fb1b-c512-401a-8e2f-b8d2db899579 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:03.487327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:03.562278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722fb1b-c512-401a-8e2f-b8d2db899579 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:03.595962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:03.596633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:03.596914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:03.597186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:03.597930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:02:03.598263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:03.599629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:03.608425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 586/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:03.614338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:03.713307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc20aa-ff92-49fe-955b-72014d264dd2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:03.747243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:03.748122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:03.748402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:03.748679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] PATH_INFO: `/v3/users/e8c2d5d054ee4a3ea962fe451f7793a2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:03.762344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c2d5d054ee4a3ea962fe451f7793a2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:03.763807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:03.765484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 596/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:02:03 2022] GET /identity/v3/users/e8c2d5d054ee4a3ea962fe451f7793a2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:03.771480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:03.859493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:03.876297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff510dcc-4bd3-4ec3-b8cf-58e6759c83af None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:03.911682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:03.912324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:03.912602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:03.912876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:03.982498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:03.983841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:04.066657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:04.082722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 587/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:02:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:02:04.091523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:04.146678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:04.190412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804964-4fd3-41ac-ab0d-95795c6d1d28 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:04.227733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0e42b-0907-4127-bcbc-11e6309b605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:04.228595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e42b-0907-4127-bcbc-11e6309b605a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:04.228874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e42b-0907-4127-bcbc-11e6309b605a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:04.229149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e42b-0907-4127-bcbc-11e6309b605a None admin] PATH_INFO: `/v3/projects/51996bb9b9224fe483e7ab31dc1a586a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:04.230372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0e42b-0907-4127-bcbc-11e6309b605a None admin] RBAC: Authorizing `identity:get_project(project_id=51996bb9b9224fe483e7ab31dc1a586a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:04.231816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0e42b-0907-4127-bcbc-11e6309b605a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:04.233577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 597/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:02:04 2022] GET /identity/v3/projects/51996bb9b9224fe483e7ab31dc1a586a => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:04.239725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:04.356795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78966-5fbf-41fb-a77d-cda83ded7fbc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:04.391593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806898-0aac-4ac9-95ef-9480053438b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:04.392257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806898-0aac-4ac9-95ef-9480053438b2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:04.392536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806898-0aac-4ac9-95ef-9480053438b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:04.392815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806898-0aac-4ac9-95ef-9480053438b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:04.393647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806898-0aac-4ac9-95ef-9480053438b2 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=51996bb9b9224fe483e7ab31dc1a586a, user.id=e8c2d5d054ee4a3ea962fe451f7793a2) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:02:04.393956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806898-0aac-4ac9-95ef-9480053438b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:04.395426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806898-0aac-4ac9-95ef-9480053438b2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:04.400953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 588/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:02:04 2022] GET /identity/v3/role_assignments?user.id=e8c2d5d054ee4a3ea962fe451f7793a2&scope.project.id=51996bb9b9224fe483e7ab31dc1a586a&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:06.460006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144814e9-bcca-4923-9563-11b8763345ed None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:06.460587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144814e9-bcca-4923-9563-11b8763345ed None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:06.460587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144814e9-bcca-4923-9563-11b8763345ed None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:06.462630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 598/1186] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:02:06.468341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef681ab-2205-41ff-bf2f-3e2d7b37bdbb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:06.468763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef681ab-2205-41ff-bf2f-3e2d7b37bdbb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:06.468891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef681ab-2205-41ff-bf2f-3e2d7b37bdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:06.485610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-eef681ab-2205-41ff-bf2f-3e2d7b37bdbb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:02:06.486823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eef681ab-2205-41ff-bf2f-3e2d7b37bdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:02:06.534182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:06.555183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 589/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:02:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:02:06.578482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144814e9-bcca-4923-9563-11b8763345ed None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:06.688669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144814e9-bcca-4923-9563-11b8763345ed None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:06.711284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:06.723466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:06.724260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:06.724549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:06.724828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:06.735103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:02:06.742788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:02:06.745246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:02:06.747271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 599/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:02:06.751090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef681ab-2205-41ff-bf2f-3e2d7b37bdbb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:06.849798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef681ab-2205-41ff-bf2f-3e2d7b37bdbb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:06.883348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:06.884566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:06.884848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:06.885124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:06.885874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:02:06.886203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:06.887580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:06.895570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 590/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:06.901685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:07.001269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d685317-ba80-41c9-9453-6d0eb9e4cc36 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:07.037789 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:07.039038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:07.039296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:07.039574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] PATH_INFO: `/v3/users/e8c2d5d054ee4a3ea962fe451f7793a2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:07.042037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] RBAC: Authorizing `identity:get_user(user_id=e8c2d5d054ee4a3ea962fe451f7793a2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:07.044863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:07.047411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 600/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:02:06 2022] GET /identity/v3/users/e8c2d5d054ee4a3ea962fe451f7793a2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:07.056137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:07.102233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:07.161692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0806f0-a5bc-4a47-942a-7b20304ab462 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:07.195227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea88749-979a-49d9-bada-9ab7d917fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:07.196135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88749-979a-49d9-bada-9ab7d917fd9d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:07.196418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88749-979a-49d9-bada-9ab7d917fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:07.196695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88749-979a-49d9-bada-9ab7d917fd9d None admin] PATH_INFO: `/v3/projects/51996bb9b9224fe483e7ab31dc1a586a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:07.197859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea88749-979a-49d9-bada-9ab7d917fd9d None admin] RBAC: Authorizing `identity:get_project(project_id=51996bb9b9224fe483e7ab31dc1a586a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:07.199308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea88749-979a-49d9-bada-9ab7d917fd9d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:07.201015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 591/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:02:07 2022] GET /identity/v3/projects/51996bb9b9224fe483e7ab31dc1a586a => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:07.207091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:07.260771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:07.308159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de7a83-be11-4ff8-b508-73ba3e48bd7e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:07.343146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c24fa-08a1-4fce-b10f-99b3d8073456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:07.344044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c24fa-08a1-4fce-b10f-99b3d8073456 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:07.344330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c24fa-08a1-4fce-b10f-99b3d8073456 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:07.344608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c24fa-08a1-4fce-b10f-99b3d8073456 None admin] PATH_INFO: `/v3/projects/51996bb9b9224fe483e7ab31dc1a586a/users/e8c2d5d054ee4a3ea962fe451f7793a2/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:07.346628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c24fa-08a1-4fce-b10f-99b3d8073456 None admin] RBAC: Authorizing `identity:create_grant(project_id=51996bb9b9224fe483e7ab31dc1a586a, user_id=e8c2d5d054ee4a3ea962fe451f7793a2, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:07.348082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c24fa-08a1-4fce-b10f-99b3d8073456 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:07.362792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 601/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:02:07 2022] PUT /identity/v3/projects/51996bb9b9224fe483e7ab31dc1a586a/users/e8c2d5d054ee4a3ea962fe451f7793a2/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:02:09.402078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93a02-1171-459a-b0f9-3a69cccac6a6 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:09.402703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93a02-1171-459a-b0f9-3a69cccac6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:09.402703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93a02-1171-459a-b0f9-3a69cccac6a6 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:09.404051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 592/1193] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:02:09.409369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffea7-b53c-44b6-82bc-732292595200 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:09.409804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffea7-b53c-44b6-82bc-732292595200 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:09.409927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffea7-b53c-44b6-82bc-732292595200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:09.428998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eb6ffea7-b53c-44b6-82bc-732292595200 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:02:09.430228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb6ffea7-b53c-44b6-82bc-732292595200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:02:09.503621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 602/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:02:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:02:09.527008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93a02-1171-459a-b0f9-3a69cccac6a6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:09.634351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93a02-1171-459a-b0f9-3a69cccac6a6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:09.644464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:09.668690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:09.669402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:09.669687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:09.669957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:09.681626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:02:09.689305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:02:09.690444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:02:09.691422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 593/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:02:09.697974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ffea7-b53c-44b6-82bc-732292595200 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:09.738614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:09.798678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ffea7-b53c-44b6-82bc-732292595200 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:09.838156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:09.838937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:09.839266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:09.839840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:09.840658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:02:09.841010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:09.842606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:09.853899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 603/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:09.859828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:09.958458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69bd7c-9fee-422e-8acf-ffd2062310c4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:09.992538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:09.993943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:09.994242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:09.994586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] PATH_INFO: `/v3/users/e8c2d5d054ee4a3ea962fe451f7793a2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:10.000041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] RBAC: Authorizing `identity:get_user(user_id=e8c2d5d054ee4a3ea962fe451f7793a2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:10.002389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:10.004049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 594/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jul 21 10:02:09 2022] GET /identity/v3/users/e8c2d5d054ee4a3ea962fe451f7793a2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:10.009967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:10.111183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ae4d2-2b54-4561-b821-7f5997a26f74 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:10.112799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:10.149949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:10.150637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:10.150923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:10.151205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:10.217920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:10.219322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:10.318716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 604/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:02:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:02:10.324787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:10.372598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:10.431927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ca0e5-8ba6-460b-a127-7109bf02136a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:10.465236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b7f12-db20-4cb1-96a5-7e05de76bdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:10.466102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7f12-db20-4cb1-96a5-7e05de76bdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:10.466407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7f12-db20-4cb1-96a5-7e05de76bdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:10.466677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7f12-db20-4cb1-96a5-7e05de76bdb8 None admin] PATH_INFO: `/v3/projects/51996bb9b9224fe483e7ab31dc1a586a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:10.467892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7f12-db20-4cb1-96a5-7e05de76bdb8 None admin] RBAC: Authorizing `identity:get_project(project_id=51996bb9b9224fe483e7ab31dc1a586a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:10.469407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7f12-db20-4cb1-96a5-7e05de76bdb8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:10.471288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 595/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jul 21 10:02:10 2022] GET /identity/v3/projects/51996bb9b9224fe483e7ab31dc1a586a => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:02:10.477829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:02:10.480068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:10.578337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6ece-0442-4356-b12f-753582c15139 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:02:10.611520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d4c70-0a18-439a-882e-30b69deae7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:02:10.612177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d4c70-0a18-439a-882e-30b69deae7ef None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:02:10.612461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d4c70-0a18-439a-882e-30b69deae7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:02:10.612738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d4c70-0a18-439a-882e-30b69deae7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:02:10.613572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d4c70-0a18-439a-882e-30b69deae7ef None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=51996bb9b9224fe483e7ab31dc1a586a, user.id=e8c2d5d054ee4a3ea962fe451f7793a2) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:02:10.613884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d4c70-0a18-439a-882e-30b69deae7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:02:10.615340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d4c70-0a18-439a-882e-30b69deae7ef None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:02:10.621679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 605/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:02:10 2022] GET /identity/v3/role_assignments?user.id=e8c2d5d054ee4a3ea962fe451f7793a2&scope.project.id=51996bb9b9224fe483e7ab31dc1a586a&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:02:20.460895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=47 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:02:20.619038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=67 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:07.456936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bfb36-4a5e-4a1b-9764-bb532d439275 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:07.457579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bfb36-4a5e-4a1b-9764-bb532d439275 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:07.457579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bfb36-4a5e-4a1b-9764-bb532d439275 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:07.459274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 596/1201] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:07.467775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5e416-4ef4-4318-8d8a-ff6b54518892 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:07.467775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5e416-4ef4-4318-8d8a-ff6b54518892 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:07.467775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5e416-4ef4-4318-8d8a-ff6b54518892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:07.486381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-30a5e416-4ef4-4318-8d8a-ff6b54518892 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:07.487834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30a5e416-4ef4-4318-8d8a-ff6b54518892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:07.573752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 606/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:07.599878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bfb36-4a5e-4a1b-9764-bb532d439275 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:07.736849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bfb36-4a5e-4a1b-9764-bb532d439275 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:07.780589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:07.781395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:07.781685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:07.781962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:07.798810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:07.800411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:07.831213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:07.832317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:07.841817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:07.841817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:07.841817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:07.841817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:07.841817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 597/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:07.842136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5e416-4ef4-4318-8d8a-ff6b54518892 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:07.992471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5e416-4ef4-4318-8d8a-ff6b54518892 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:08.029183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:08.039821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f310cc-75b5-4450-91ea-638f9fbbf99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:08.040760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f310cc-75b5-4450-91ea-638f9fbbf99b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:08.041098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f310cc-75b5-4450-91ea-638f9fbbf99b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:08.041450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f310cc-75b5-4450-91ea-638f9fbbf99b None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:08.042217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f310cc-75b5-4450-91ea-638f9fbbf99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:08.042581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f310cc-75b5-4450-91ea-638f9fbbf99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:08.044031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f310cc-75b5-4450-91ea-638f9fbbf99b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:08.070305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 607/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:08.075274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:08.154767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:08.230301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16127-f3ed-4869-936d-a894a009195d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:08.284340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53192fdf-a891-4a47-a61e-0aefb0273220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:08.284340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53192fdf-a891-4a47-a61e-0aefb0273220 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:08.284340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53192fdf-a891-4a47-a61e-0aefb0273220 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:08.284340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53192fdf-a891-4a47-a61e-0aefb0273220 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:08.284749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53192fdf-a891-4a47-a61e-0aefb0273220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:08.284749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53192fdf-a891-4a47-a61e-0aefb0273220 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:08.310050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 598/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jul 21 10:03:08 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:03:10.710478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17069-5f7d-48d9-b632-113ec11807e5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:10.711069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17069-5f7d-48d9-b632-113ec11807e5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:10.711069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17069-5f7d-48d9-b632-113ec11807e5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:10.712731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 608/1206] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:10.720163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c30ad-090c-458c-97d4-4c45638d5d16 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:10.720776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c30ad-090c-458c-97d4-4c45638d5d16 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:10.720776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c30ad-090c-458c-97d4-4c45638d5d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:10.747655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9d0c30ad-090c-458c-97d4-4c45638d5d16 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:10.749318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9d0c30ad-090c-458c-97d4-4c45638d5d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:10.847451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 599/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:10.872508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a17069-5f7d-48d9-b632-113ec11807e5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:11.013369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a17069-5f7d-48d9-b632-113ec11807e5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:11.054431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:11.055504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:11.055846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:11.056244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:11.070471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:03:11.081097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:11.082296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:11.083582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 609/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:03:11.090973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c30ad-090c-458c-97d4-4c45638d5d16 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:11.144559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:11.218919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c30ad-090c-458c-97d4-4c45638d5d16 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:11.272735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:11.273421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:11.273807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:11.274211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:11.275165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:11.275488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:11.277121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:11.291807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 600/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:03:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:11.293816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:11.371257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:11.442695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50267cf5-9784-44e3-9bbd-7412c39ad264 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:11.481102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:11.482071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:11.482388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:11.482751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:11.501250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:11.501250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:11.522144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:11.523942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:11.525759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:11.525759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:11.525759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:11.525759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:11.525759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 610/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:11.529391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:11.667568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:11.669878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3c35-42ff-47ea-8e5e-1836ba2370cc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:11.713430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:11.714757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:11.715052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:11.715393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:11.716163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:11.716478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:11.717941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:11.737555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 601/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:11.738854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:11.856156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9d01-1796-4dcd-9a85-d0d9c89cef1f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:11.856156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:11.898894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:11.899708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:11.899993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:11.900274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:11.909892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:11.911649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:03:11.931949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:11.937202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:11.938215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 611/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:11.942054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:12.087278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a47f0-78c7-4593-828a-ea030d29cd0d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:12.131601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:12.132594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:12.132940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:12.133246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:12.134294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:12.135429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:12.136488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:12.166276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 602/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jul 21 10:03:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:12.167937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:12.310763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f0ab-122a-4ffa-8ab4-2a79f035e202 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:12.351784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:12.353064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:12.353064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:12.353258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:12.390044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:12.435996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:12.437568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:12.556980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 612/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:03:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:03:12.563394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:12.588491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:12.691540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dab6b-4bf2-48ec-8dbf-7ab0f4260e00 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:12.733302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:12.734125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:12.734438 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:12.734721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:12.746416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:12.747824 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:12.770458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:12.772291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:12.774909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:12.774909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:12.774909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:12.774909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:12.774909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 603/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:12.778282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:12.848048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:12.894184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ca6a6-03db-4d40-864e-80ad4b24ccb6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:12.935077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:12.935754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:12.936040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:12.936319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:12.937065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:12.937368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:12.938807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:12.951217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 613/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:12.956799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:13.038498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:13.075720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56da560-15d5-49df-a226-7f2144cdfe96 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:13.121686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:13.122657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:13.122912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:13.123241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:13.131862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:13.133580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:03:13.150903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:13.153113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:13.154283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:13.158373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 604/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:13.159423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:13.289316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687bb0e-1bb8-42ad-8a17-447af2ccfa3c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:13.314132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:13.326762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c567bd-bf39-4cde-86de-b77f460b65d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:13.327472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c567bd-bf39-4cde-86de-b77f460b65d4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:13.327756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c567bd-bf39-4cde-86de-b77f460b65d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:13.328032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c567bd-bf39-4cde-86de-b77f460b65d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:13.328840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c567bd-bf39-4cde-86de-b77f460b65d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:13.329150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c567bd-bf39-4cde-86de-b77f460b65d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:13.330754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c567bd-bf39-4cde-86de-b77f460b65d4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:13.345929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 614/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:13.351901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:13.470211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0e0f3-87a4-4ea4-a230-a5313ad939d9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:13.500616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:13.508735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d0c2f-0f8f-4270-99cc-8d16e7ae12ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:13.509456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0c2f-0f8f-4270-99cc-8d16e7ae12ef None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:13.509745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0c2f-0f8f-4270-99cc-8d16e7ae12ef None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:13.510026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0c2f-0f8f-4270-99cc-8d16e7ae12ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:13.510941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d0c2f-0f8f-4270-99cc-8d16e7ae12ef None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=f1493c0e47d2452ba971464c7d0be294) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:13.511284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d0c2f-0f8f-4270-99cc-8d16e7ae12ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:13.512858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d0c2f-0f8f-4270-99cc-8d16e7ae12ef None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:13.519757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 605/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:03:13 2022] GET /identity/v3/role_assignments?user.id=f1493c0e47d2452ba971464c7d0be294&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:15.681181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d4f2-20d2-4577-a8fa-3fc6dcc7bedb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:15.681181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d4f2-20d2-4577-a8fa-3fc6dcc7bedb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:15.681181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d4f2-20d2-4577-a8fa-3fc6dcc7bedb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:15.682635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 615/1220] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:15.689429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd79a-f1c7-49be-b0e2-5315ad1d948d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:15.689963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd79a-f1c7-49be-b0e2-5315ad1d948d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:15.690056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd79a-f1c7-49be-b0e2-5315ad1d948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:15.707173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e55cd79a-f1c7-49be-b0e2-5315ad1d948d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:15.708567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e55cd79a-f1c7-49be-b0e2-5315ad1d948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:15.784906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 606/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:15.809124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d4f2-20d2-4577-a8fa-3fc6dcc7bedb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:15.936188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d4f2-20d2-4577-a8fa-3fc6dcc7bedb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:15.979735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:15.980700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:15.981064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:15.981386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:15.994078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:03:16.003194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:16.004380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:16.005280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 616/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:16.011637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd79a-f1c7-49be-b0e2-5315ad1d948d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:16.119765 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd79a-f1c7-49be-b0e2-5315ad1d948d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:16.145444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:16.157452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:16.158214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:16.158462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:16.158740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:16.159512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:16.159822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:16.161217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:16.171552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 607/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:03:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:16.178033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:16.231159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:16.301416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f6df-c0b2-468c-8685-cb0cbb974550 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:16.340955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:16.341773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:16.342076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:16.342437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:16.354757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:16.356277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:16.374723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:16.376312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:16.378382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:16.378382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:16.378382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:16.378382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:16.378382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 617/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:16.386060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:16.490777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80e3e-5928-4ad3-ba36-dd19b3e15c8a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:16.529991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:16.530707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:16.531008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:16.531308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:16.532044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:16.532347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:16.533755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:16.553737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 608/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:16.555350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:16.663836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:16.672210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e53f35-5064-4112-998a-b2682ed827f9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:16.708062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:16.708873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:16.709145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:16.709422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:16.717912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:16.719491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:03:16.736678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:16.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:16.741298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 618/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:03:16.744812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:16.796182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:16.862951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538709-c5a3-4936-b9fb-7ef3ab320f28 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:16.898433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:16.899113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:16.899397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:16.899669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:16.900515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:16.900826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:16.902502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:16.922580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 609/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jul 21 10:03:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:16.928904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:17.043449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46afe5-e78e-4ffa-aa1f-ad4a31ed104a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:17.085602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:17.086546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:17.086876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:17.087210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:17.101354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:17.103150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:17.123883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:17.125072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:17.126232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:17.126232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:17.126232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:17.126232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:17.131357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:17.131813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 619/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:17.260244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c6de9-bdf0-4196-aeb0-45b1a6a59507 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:17.262888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:17.303469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:17.304415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:17.304739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:17.305069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:17.305952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:17.306352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:17.307871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:17.321914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 610/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:17.327969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:17.340458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:17.445298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea835a-2447-44e7-bdbe-20641f9b07db None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:17.490075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:17.490932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:17.491215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:17.491491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:17.500480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:17.502126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:03:17.518739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:17.520105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:17.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:17.525714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 620/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:17.527009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:17.648843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0ad2-ba95-4a1a-9f97-449658ca5641 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:17.690736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0415d-37d4-4413-bb9d-a290a98844b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:17.691435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0415d-37d4-4413-bb9d-a290a98844b2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:17.692086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0415d-37d4-4413-bb9d-a290a98844b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:17.692401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0415d-37d4-4413-bb9d-a290a98844b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:17.693814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0415d-37d4-4413-bb9d-a290a98844b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:17.694123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0415d-37d4-4413-bb9d-a290a98844b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:17.695827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0415d-37d4-4413-bb9d-a290a98844b2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:17.715732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 611/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:17.717518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:17.794030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:17.838519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7913c-934c-43c4-86b1-b9b3e5f2f80a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:17.880375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5fe0-3b36-45eb-b335-d7efb5e03671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:17.881877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5fe0-3b36-45eb-b335-d7efb5e03671 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:17.882581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5fe0-3b36-45eb-b335-d7efb5e03671 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:17.882863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5fe0-3b36-45eb-b335-d7efb5e03671 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/f1493c0e47d2452ba971464c7d0be294/roles/8bbb1d5f1b1047ffa69f7573478e9e6e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:17.901426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5fe0-3b36-45eb-b335-d7efb5e03671 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=f1493c0e47d2452ba971464c7d0be294, role_id=8bbb1d5f1b1047ffa69f7573478e9e6e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:17.902912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5fe0-3b36-45eb-b335-d7efb5e03671 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:17.915470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 621/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:03:17 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/f1493c0e47d2452ba971464c7d0be294/roles/8bbb1d5f1b1047ffa69f7573478e9e6e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:03:19.995792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3b5e-46bb-4297-9161-3a6e00b0cc1c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:19.996374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3b5e-46bb-4297-9161-3a6e00b0cc1c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:19.996374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3b5e-46bb-4297-9161-3a6e00b0cc1c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:19.997704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 612/1233] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:20.003276 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810eb87-c1f4-45e5-9d9f-83ee4d7223eb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:20.003883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810eb87-c1f4-45e5-9d9f-83ee4d7223eb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:20.003883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810eb87-c1f4-45e5-9d9f-83ee4d7223eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:20.020924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6810eb87-c1f4-45e5-9d9f-83ee4d7223eb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:20.022155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6810eb87-c1f4-45e5-9d9f-83ee4d7223eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:20.106210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 622/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:20.131264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3b5e-46bb-4297-9161-3a6e00b0cc1c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:20.159209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:20.246727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3b5e-46bb-4297-9161-3a6e00b0cc1c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:20.289085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:20.290128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:20.290485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:20.290766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:20.303599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:03:20.311534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:20.312684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:20.313724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 613/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jul 21 10:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:20.319070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810eb87-c1f4-45e5-9d9f-83ee4d7223eb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:20.381510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:20.445570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810eb87-c1f4-45e5-9d9f-83ee4d7223eb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:20.490776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:20.491708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:20.492136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:20.492572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:20.493534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:20.494035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:20.495791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:20.505974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 623/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jul 21 10:03:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:20.511836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:20.623355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:20.645074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d812-f1a3-47a0-9fb6-666569b44acb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:20.688628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:20.689401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:20.689691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:20.689967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:20.710298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:20.711842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:20.732487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:20.733739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:20.734864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:20.734864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:20.734864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:20.734864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:20.739271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 614/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:20.740369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:20.869676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336fb9-f0fb-436c-b055-dfb5be12d824 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:20.880187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:20.917377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:20.918385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:20.918844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:20.919221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:20.920230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:20.920729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:20.922549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:20.939965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 624/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:20.947452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:21.078463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc00ea-dc5e-4ff8-a6ce-384a99630e91 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:21.144708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:21.146118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:21.146659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:21.147124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:21.152359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:21.159677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:21.161568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:03:21.181063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:21.182986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:21.183898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 615/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:21.185234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:21.305848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00edf-589c-455d-9147-fcf02569b4f3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:21.346324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:21.347075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:21.347423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:21.347764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:21.348755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:21.349629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:21.351304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:21.372478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 625/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jul 21 10:03:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:21.378736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:21.523259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e51f5-2bf5-4e39-a50d-1d21aea9f1ef None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:21.564213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:21.564934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:21.565216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:21.565493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:21.640114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:21.650366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:21.652307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:21.776304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 616/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:03:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:03:21.782139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:21.814097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:21.909664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007339-7a36-45d2-8abf-e381d7342147 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:21.947951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:21.949333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:21.949861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:21.950408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:21.963612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:21.965396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:21.985741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:21.987206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:21.988354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:21.988354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:21.988354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:21.988354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:21.988354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 626/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:21.993951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:22.113830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:22.125209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453bf4-065b-4a8d-87a4-563e2f76446c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:22.162088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:22.162802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:22.163083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:22.163358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:22.164103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:22.164416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:22.167647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:22.179100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 617/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:22.185724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:22.286144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:22.321995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac54e2-a6d7-4082-9b21-9a6a6c0bef83 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:22.372024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:22.373067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:22.373562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:22.374048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:22.383662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:22.385548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:03:22.401865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:22.403153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:22.404275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 627/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:03:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:22.409418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:22.534033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122d5f-fda6-4e89-b82f-2bc278df0100 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:22.579909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51d61-dccf-49b3-ad2b-427dcefaa3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:22.580614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51d61-dccf-49b3-ad2b-427dcefaa3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:22.580895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51d61-dccf-49b3-ad2b-427dcefaa3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:22.581169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51d61-dccf-49b3-ad2b-427dcefaa3b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:22.581978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51d61-dccf-49b3-ad2b-427dcefaa3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:22.582460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51d61-dccf-49b3-ad2b-427dcefaa3b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:22.584132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51d61-dccf-49b3-ad2b-427dcefaa3b2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:22.602250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 618/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:03:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:22.609007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:22.724706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e85954-c6c1-46e4-8cb0-e36d2f4c80bb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:22.762427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07e7b0-e8ac-408d-9c45-2ec6a30a180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:22.764897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e7b0-e8ac-408d-9c45-2ec6a30a180b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:22.764897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e7b0-e8ac-408d-9c45-2ec6a30a180b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:22.764897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e7b0-e8ac-408d-9c45-2ec6a30a180b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:22.764897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07e7b0-e8ac-408d-9c45-2ec6a30a180b None admin] RBAC: Adding query filter params (role.id=8bbb1d5f1b1047ffa69f7573478e9e6e, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=f1493c0e47d2452ba971464c7d0be294) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:22.764897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07e7b0-e8ac-408d-9c45-2ec6a30a180b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:22.766679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07e7b0-e8ac-408d-9c45-2ec6a30a180b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:22.775028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 628/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:03:22 2022] GET /identity/v3/role_assignments?user.id=f1493c0e47d2452ba971464c7d0be294&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=8bbb1d5f1b1047ffa69f7573478e9e6e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:25.224360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcfc9-ac79-4602-8073-9f4ad65188a8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:25.224914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcfc9-ac79-4602-8073-9f4ad65188a8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:25.224991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcfc9-ac79-4602-8073-9f4ad65188a8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:25.226530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 619/1247] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:25.233439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda2b98-3b3e-46cd-93fb-c066bc4cfb6f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:25.233950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda2b98-3b3e-46cd-93fb-c066bc4cfb6f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:25.234234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda2b98-3b3e-46cd-93fb-c066bc4cfb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:25.240500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:25.258933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4cda2b98-3b3e-46cd-93fb-c066bc4cfb6f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:25.260536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4cda2b98-3b3e-46cd-93fb-c066bc4cfb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:25.345844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 629/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:25.374790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcfc9-ac79-4602-8073-9f4ad65188a8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:25.395715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:25.507222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcfc9-ac79-4602-8073-9f4ad65188a8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:25.547511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:25.548317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:25.548597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:25.548871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:25.564165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:03:25.577323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:25.578534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:25.579992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 620/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:25.584764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda2b98-3b3e-46cd-93fb-c066bc4cfb6f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:25.718655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda2b98-3b3e-46cd-93fb-c066bc4cfb6f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:25.758535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:25.760834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:25.761917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:25.762626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:25.763316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:25.764334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:25.764737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:25.766447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:25.776815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 630/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:25.783139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:25.876922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:25.908325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a695ad8-cb41-46a7-9923-f8424b018e56 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:25.948362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:25.949193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:25.949526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:25.949761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:25.963381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:25.965139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:25.983692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:25.985628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:25.987375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:25.987375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:25.987375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:25.987375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:25.987375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 621/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:25.991660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:26.116223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12527e4-802c-4558-b096-8433eadcf15c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:26.166124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:26.167146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:26.167617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:26.168104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:26.169299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:26.169700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:26.171640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:26.188284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 631/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:26.195132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:26.324049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480030f-ba64-486b-b373-741b8d580c50 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:26.358712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:26.368866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:26.369644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:26.369927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:26.370230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:26.378526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:26.379991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:03:26.396331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:26.397887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:26.398900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 622/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:26.404393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:26.481711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:26.542545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd156f-3bf5-41ae-b654-bce9a973f53f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:26.589330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:26.590247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:26.590694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:26.590981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:26.592121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:26.592439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:26.593898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:26.616275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 632/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jul 21 10:03:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:26.623719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:26.763602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25bf15-4750-4648-95af-2c1d2de95037 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:26.807606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:26.808264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:26.808547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:26.808820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:26.879629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:26.898747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:26.900362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:27.040013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 623/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:03:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:03:27.047126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:27.164543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd34ec8-326e-4b7a-8a95-5433b6f6a40f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:27.179511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:27.204463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:27.205282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:27.205567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:27.205838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:27.219527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:27.222518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:27.244319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:27.245704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:27.247252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:27.247252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:27.247252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:27.247252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:27.247252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 633/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:27.252172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:27.353533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:27.368353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520b8a4-a186-404f-b07f-c4812282be2c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:27.406482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:27.407075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:27.407408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:27.407676 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:27.408355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:27.408670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:27.410057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:27.423088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 624/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:27.429989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:27.552656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601635f-5041-4b66-a8f5-af3a1da26cec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:27.596396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:27.597174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:27.597462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:27.597741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:27.613017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:27.615220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:03:27.631633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:27.632749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:27.633831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 634/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:03:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:03:27.639151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:27.756417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61608153-45f3-47a9-af6b-d72b87d9ec09 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:27.796503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7df48-1084-4ef0-b88d-393f47f1a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:27.797246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7df48-1084-4ef0-b88d-393f47f1a56e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:27.797560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7df48-1084-4ef0-b88d-393f47f1a56e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:27.797810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7df48-1084-4ef0-b88d-393f47f1a56e None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:27.798722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7df48-1084-4ef0-b88d-393f47f1a56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:27.799104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7df48-1084-4ef0-b88d-393f47f1a56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:27.800589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7df48-1084-4ef0-b88d-393f47f1a56e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:27.813832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 625/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:03:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:27.820432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:27.850934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:27.939392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fa2f3-e593-4932-8c79-5c21f26dfd7b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:27.977141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64e1e-db80-4b7b-b4df-77a9367d531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:27.977831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64e1e-db80-4b7b-b4df-77a9367d531e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:27.978110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64e1e-db80-4b7b-b4df-77a9367d531e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:27.978409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64e1e-db80-4b7b-b4df-77a9367d531e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:27.979281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64e1e-db80-4b7b-b4df-77a9367d531e None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=f1493c0e47d2452ba971464c7d0be294) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:27.979610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64e1e-db80-4b7b-b4df-77a9367d531e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:27.981056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64e1e-db80-4b7b-b4df-77a9367d531e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:27.989481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 635/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:03:27 2022] GET /identity/v3/role_assignments?user.id=f1493c0e47d2452ba971464c7d0be294&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:30.101025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d3e6-7cc2-46f1-931d-0f56eb476cf0 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:30.101616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d3e6-7cc2-46f1-931d-0f56eb476cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:30.101616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d3e6-7cc2-46f1-931d-0f56eb476cf0 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:30.103316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 626/1261] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:30.109713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58939b5a-410c-4d62-9665-42fa3f83bc2b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:30.110244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58939b5a-410c-4d62-9665-42fa3f83bc2b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:30.110370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58939b5a-410c-4d62-9665-42fa3f83bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:30.126838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-58939b5a-410c-4d62-9665-42fa3f83bc2b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:30.128033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-58939b5a-410c-4d62-9665-42fa3f83bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:30.197586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 636/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:30.220482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d3e6-7cc2-46f1-931d-0f56eb476cf0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:30.233619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:30.325948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d3e6-7cc2-46f1-931d-0f56eb476cf0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:30.359411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:30.360131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:30.360410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:30.360682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:30.370508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:03:30.378051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:30.379162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:30.385425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 627/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:30.386146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58939b5a-410c-4d62-9665-42fa3f83bc2b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:30.404893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:30.484991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58939b5a-410c-4d62-9665-42fa3f83bc2b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:30.518472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:30.519170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:30.519500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:30.519782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:30.520536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:30.521634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:30.523053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:30.531331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 637/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:03:30.537244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:30.604521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:30.641009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac77fc1-7526-461a-b708-3970aaeff9d3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:30.674659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:30.675442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:30.675722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:30.675995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:30.686658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:30.688086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:30.705865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:30.707131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:30.708159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:30.708159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:30.708159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:30.708159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:30.708159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 628/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:30.713113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:30.791166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:30.810624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae829-9069-4e10-9d8f-0b25d13ca021 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:30.844858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:30.845505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:30.845787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:30.846062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:30.846809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:30.847114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:30.848472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:30.859733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 638/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:30.866098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:30.962337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b7d6d-8ff8-45e0-b0eb-9236c216f8c8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:30.981971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:30.996071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:30.996868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:30.997151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:30.997425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:31.004695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:31.006194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:03:31.020065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:31.021619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:31.022684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 629/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:31.027251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:31.145683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d0c1-8d9a-46dc-929a-2c674eeb8e51 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:31.182125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:31.182830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:31.183114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:31.183385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:31.184241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:31.184553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:31.185985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:31.194855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:31.203802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 639/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jul 21 10:03:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:31.209480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:31.314876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccaa7b-b7a7-4355-a790-48890ee77388 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:31.354431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:31.355241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:31.355527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:31.355807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:31.367252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:31.368702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:31.385903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:31.387047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:31.388146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:31.388146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:31.388146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:31.388146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:31.388146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 630/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:31.392893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:31.498436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd80842-c4c4-4319-8869-9775a778f9df None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:31.532146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:31.532806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:31.533087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:31.533357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:31.534076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:31.534413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:31.535788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:31.548166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 640/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:31.553799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:31.585291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:31.653882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff2547-42f6-41a3-929f-58dd96fbd2be None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:31.687241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:31.688042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:31.688324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:31.688595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:31.695515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:31.696967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:03:31.711829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:31.712946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:31.714161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 631/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:31.719086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:31.777863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:31.819180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d9e3e-f585-4ff0-8174-2220d29d4db4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:31.854581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2bc1-007d-488d-a55f-915cb2b5ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:31.855170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2bc1-007d-488d-a55f-915cb2b5ef03 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:31.855452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2bc1-007d-488d-a55f-915cb2b5ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:31.855727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2bc1-007d-488d-a55f-915cb2b5ef03 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:31.856514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2bc1-007d-488d-a55f-915cb2b5ef03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:31.856821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2bc1-007d-488d-a55f-915cb2b5ef03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:31.858275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2bc1-007d-488d-a55f-915cb2b5ef03 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:31.870342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 641/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:31.876354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:31.968207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:31.977201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9591f9-003f-4c17-a0b8-e2b44d35d81c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:32.011273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637518a-011e-475d-b1f2-4c0b7c2cc685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:32.012164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637518a-011e-475d-b1f2-4c0b7c2cc685 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:32.012446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637518a-011e-475d-b1f2-4c0b7c2cc685 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:32.012722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637518a-011e-475d-b1f2-4c0b7c2cc685 None admin] PATH_INFO: `/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/f1493c0e47d2452ba971464c7d0be294/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:32.014704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637518a-011e-475d-b1f2-4c0b7c2cc685 None admin] RBAC: Authorizing `identity:create_grant(project_id=302e0852b0af4faf94dc9383d5b47175, user_id=f1493c0e47d2452ba971464c7d0be294, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:32.016137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637518a-011e-475d-b1f2-4c0b7c2cc685 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:32.030610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 632/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jul 21 10:03:31 2022] PUT /identity/v3/projects/302e0852b0af4faf94dc9383d5b47175/users/f1493c0e47d2452ba971464c7d0be294/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:03:34.059486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ee47-886c-4319-a9fc-41ffa847fba0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:34.060263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ee47-886c-4319-a9fc-41ffa847fba0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:34.060263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ee47-886c-4319-a9fc-41ffa847fba0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:34.061618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 642/1274] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:34.067903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947260-b001-49e9-b6f4-68bd25980eb2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:34.068397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947260-b001-49e9-b6f4-68bd25980eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:34.068491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947260-b001-49e9-b6f4-68bd25980eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:34.085623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a3947260-b001-49e9-b6f4-68bd25980eb2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:34.086871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a3947260-b001-49e9-b6f4-68bd25980eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:34.171512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 633/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:34.195463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ee47-886c-4319-a9fc-41ffa847fba0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:34.303742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ee47-886c-4319-a9fc-41ffa847fba0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:34.321064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:34.338975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:34.339784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:34.340069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:34.340346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:34.351602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:03:34.359385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:34.360512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:34.367249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 643/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jul 21 10:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:34.368946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3947260-b001-49e9-b6f4-68bd25980eb2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:34.451587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:34.471037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3947260-b001-49e9-b6f4-68bd25980eb2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:34.505938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:34.506656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:34.506937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:34.507210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:34.507967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:34.508272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:34.509638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:34.518312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 634/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jul 21 10:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:34.524582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:34.628771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec9b4a-5ee4-4f2b-bde1-cfe50054cf31 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:34.664468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:34.665256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:34.665540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:34.665814 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:34.676527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:34.680159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:34.701859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:34.703080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:34.704263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:34.704263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:34.704263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:34.704263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:34.704263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 644/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:34.709689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:34.815315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad619de-3a28-4308-be2e-a9f2049f6732 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:34.849564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:34.850529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:34.850809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:34.851082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:34.851809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:34.852117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:34.853488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:34.865794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 635/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:34.871557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:34.904354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:34.976195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a54b6-8ae6-4a04-8fc4-5928c2226704 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:35.012103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191b44-b332-4113-be45-a054881b1faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:35.012900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191b44-b332-4113-be45-a054881b1faf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:35.013182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191b44-b332-4113-be45-a054881b1faf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:35.013455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191b44-b332-4113-be45-a054881b1faf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:35.021938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191b44-b332-4113-be45-a054881b1faf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:35.023438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191b44-b332-4113-be45-a054881b1faf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-88191b44-b332-4113-be45-a054881b1faf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:03:35.037890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:35.039030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:35.040005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 645/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:35.045078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:35.048983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:35.149533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed688a5e-f775-472d-b12e-08967481383f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:35.184207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:35.184795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:35.185077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:35.185348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:35.186210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:35.186523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:35.187960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:35.205832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 636/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jul 21 10:03:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:35.211957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191b44-b332-4113-be45-a054881b1faf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:35.310853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:35.321524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191b44-b332-4113-be45-a054881b1faf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:35.357690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:35.358373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:35.358658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:35.358933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:35.433096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:35.435261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:35.534392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:35.546042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 646/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jul 21 10:03:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:03:35.552443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:35.613659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:35.654976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4edc5-4278-4628-85ab-92ae59f5288d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:35.689873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:35.690619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:35.690902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:35.691172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:35.701837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:35.703333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:03:35.721501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:35.723288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:35.725335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:03:35.725335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:03:35.725335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:03:35.725335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:35.725335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 637/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:35.729369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:35.833438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb1da-1a0f-468b-adbc-8c875b11165d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:35.868175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:35.868844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:35.869125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:35.869403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:35.870133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:35.870473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:35.871859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:35.883399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 647/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jul 21 10:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:35.889107 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:35.991442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9baaa-18f0-4c07-96c4-14bc5869d528 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:36.005429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:36.026383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:36.027204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:36.027527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:36.027734 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:36.034937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:36.037038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:03:36.051418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:36.052540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:03:36.053459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 638/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jul 21 10:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:36.060076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:36.125251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:36.175508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8783-14d5-4e0a-9137-cfd16b5caaa2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:36.210896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a2883-d6a3-4d74-b995-13aac84a8856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:36.211564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a2883-d6a3-4d74-b995-13aac84a8856 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:36.211849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a2883-d6a3-4d74-b995-13aac84a8856 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:36.212130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a2883-d6a3-4d74-b995-13aac84a8856 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:36.212930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a2883-d6a3-4d74-b995-13aac84a8856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:36.213247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a2883-d6a3-4d74-b995-13aac84a8856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:36.214979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a2883-d6a3-4d74-b995-13aac84a8856 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:36.228632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 648/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jul 21 10:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:36.234765 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:36.335921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03cc9-cc07-4d67-a2fa-e1caca1f8d90 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:36.370131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff203-d6bb-42be-833a-ccdb45b65287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:36.370817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff203-d6bb-42be-833a-ccdb45b65287 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:36.371101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff203-d6bb-42be-833a-ccdb45b65287 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:36.371376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff203-d6bb-42be-833a-ccdb45b65287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:36.372213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff203-d6bb-42be-833a-ccdb45b65287 None admin] RBAC: Adding query filter params (role.id=d250c98aac41424fb8b1372e642d0f30, scope.project.id=302e0852b0af4faf94dc9383d5b47175, user.id=f1493c0e47d2452ba971464c7d0be294) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:36.372526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff203-d6bb-42be-833a-ccdb45b65287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:36.373975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff203-d6bb-42be-833a-ccdb45b65287 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:36.380747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 639/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jul 21 10:03:36 2022] GET /identity/v3/role_assignments?user.id=f1493c0e47d2452ba971464c7d0be294&scope.project.id=302e0852b0af4faf94dc9383d5b47175&role.id=d250c98aac41424fb8b1372e642d0f30 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:38.450540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab568da0-7eb0-4e07-bb5e-a1b221f64de8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:38.451143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab568da0-7eb0-4e07-bb5e-a1b221f64de8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:38.451143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab568da0-7eb0-4e07-bb5e-a1b221f64de8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:38.452456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 649/1288] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:38.458579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1b7b-972c-474a-9edd-e6bf03101f69 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:38.459061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1b7b-972c-474a-9edd-e6bf03101f69 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:38.459176 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1b7b-972c-474a-9edd-e6bf03101f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:38.477401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-85af1b7b-972c-474a-9edd-e6bf03101f69 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:38.478631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-85af1b7b-972c-474a-9edd-e6bf03101f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:38.509714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:38.547566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 640/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:38.570287 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab568da0-7eb0-4e07-bb5e-a1b221f64de8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:38.674599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab568da0-7eb0-4e07-bb5e-a1b221f64de8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:38.686223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:38.710608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:38.711332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:38.711614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:38.711891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:38.712545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:38.714204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:38.726749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:38.728061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:38.729139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 650/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:03:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:38.734108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1b7b-972c-474a-9edd-e6bf03101f69 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:38.841928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1b7b-972c-474a-9edd-e6bf03101f69 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:38.880187 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c4cfd-5c15-41e1-b1e8-786b5dcd69d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:38.880861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c4cfd-5c15-41e1-b1e8-786b5dcd69d6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:38.881143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c4cfd-5c15-41e1-b1e8-786b5dcd69d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:38.881420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c4cfd-5c15-41e1-b1e8-786b5dcd69d6 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:38.882141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c4cfd-5c15-41e1-b1e8-786b5dcd69d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:38.882482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c4cfd-5c15-41e1-b1e8-786b5dcd69d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:38.883867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c4cfd-5c15-41e1-b1e8-786b5dcd69d6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:38.888972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 641/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jul 21 10:03:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:38.895634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:39.001367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bf635-5b3e-44f3-9c38-2965625ef218 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:39.042670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a5bd4-14b8-4c0a-ad26-916a954ec3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:39.043337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a5bd4-14b8-4c0a-ad26-916a954ec3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:39.043616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a5bd4-14b8-4c0a-ad26-916a954ec3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:39.043890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a5bd4-14b8-4c0a-ad26-916a954ec3b2 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:39.044599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a5bd4-14b8-4c0a-ad26-916a954ec3b2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:39.044904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a5bd4-14b8-4c0a-ad26-916a954ec3b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:39.046301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a5bd4-14b8-4c0a-ad26-916a954ec3b2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:39.051034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 651/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jul 21 10:03:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:41.116092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc694-74b8-4618-8ea5-db052df81948 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:41.116677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc694-74b8-4618-8ea5-db052df81948 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:41.116775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc694-74b8-4618-8ea5-db052df81948 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:41.118121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 642/1293] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:41.124718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0e931-5cba-4f5d-8425-21e6af760b4f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:41.125235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0e931-5cba-4f5d-8425-21e6af760b4f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:41.125366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0e931-5cba-4f5d-8425-21e6af760b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:41.143302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-98e0e931-5cba-4f5d-8425-21e6af760b4f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:41.144542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-98e0e931-5cba-4f5d-8425-21e6af760b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:41.177062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:41.215359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 652/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:41.238131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc694-74b8-4618-8ea5-db052df81948 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:41.269859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:41.342663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc694-74b8-4618-8ea5-db052df81948 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:41.377562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a440b5-5226-4fe0-8503-ecc66b588abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:41.378149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a440b5-5226-4fe0-8503-ecc66b588abb None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:41.378463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a440b5-5226-4fe0-8503-ecc66b588abb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:41.378738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a440b5-5226-4fe0-8503-ecc66b588abb None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:41.380080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a440b5-5226-4fe0-8503-ecc66b588abb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:41.381462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a440b5-5226-4fe0-8503-ecc66b588abb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:41.395543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 643/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jul 21 10:03:41 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:03:43.454192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250849f-df07-4c5a-b6ef-a3d72065a5f3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:43.454734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250849f-df07-4c5a-b6ef-a3d72065a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:43.454823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250849f-df07-4c5a-b6ef-a3d72065a5f3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:43.456128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 653/1296] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:43.461914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10698fdb-e47f-41a0-b243-1cafefe29131 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:43.462375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10698fdb-e47f-41a0-b243-1cafefe29131 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:43.462496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10698fdb-e47f-41a0-b243-1cafefe29131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:43.480664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-10698fdb-e47f-41a0-b243-1cafefe29131 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:43.481858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-10698fdb-e47f-41a0-b243-1cafefe29131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:43.569589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 644/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:43.592893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250849f-df07-4c5a-b6ef-a3d72065a5f3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:43.700419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250849f-df07-4c5a-b6ef-a3d72065a5f3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:43.738579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:43.739334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:43.739618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:43.739894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:43.740599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:43.741983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:43.753975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:43.755873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:43.756931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 654/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:03:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:43.761832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10698fdb-e47f-41a0-b243-1cafefe29131 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:43.780431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:43.863257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10698fdb-e47f-41a0-b243-1cafefe29131 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:43.900728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:43.901400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:43.901678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:43.901949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:43.902689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:43.902993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:43.904361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:43.909630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 645/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jul 21 10:03:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:43.915725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:43.947494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:44.016708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58593341-7f5a-4033-bb89-23ced188b453 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:44.052193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5090-f635-4a61-912b-b06637290793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:44.052865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5090-f635-4a61-912b-b06637290793 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:44.053150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5090-f635-4a61-912b-b06637290793 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:44.053426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5090-f635-4a61-912b-b06637290793 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:44.054249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5090-f635-4a61-912b-b06637290793 None admin] RBAC: Adding query filter params (interface=public, service_id=4758e3abbf1f45fd924a57495606416f, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:44.054566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5090-f635-4a61-912b-b06637290793 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:44.055942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5090-f635-4a61-912b-b06637290793 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:44.061259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 655/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jul 21 10:03:43 2022] GET /identity/v3/endpoints?service_id=4758e3abbf1f45fd924a57495606416f&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:44.067926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:44.164417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:44.183033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53cd03-5015-4445-a442-c835a63d4462 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:44.217390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e59a8-d459-4e94-80fc-9472a07d6b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:44.218067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e59a8-d459-4e94-80fc-9472a07d6b08 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:44.218382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e59a8-d459-4e94-80fc-9472a07d6b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:44.218663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e59a8-d459-4e94-80fc-9472a07d6b08 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:44.219354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e59a8-d459-4e94-80fc-9472a07d6b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:44.220733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e59a8-d459-4e94-80fc-9472a07d6b08 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:44.228262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 646/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jul 21 10:03:44 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:03:46.261666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43644b-a8c5-4dac-8761-e51766793cf2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:46.262339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43644b-a8c5-4dac-8761-e51766793cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:46.262339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43644b-a8c5-4dac-8761-e51766793cf2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:46.263624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 656/1302] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:03:46.268911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a89a-03c2-4352-ad1c-b50e65a34f38 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:46.269413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a89a-03c2-4352-ad1c-b50e65a34f38 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:46.269535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a89a-03c2-4352-ad1c-b50e65a34f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:46.286911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d1e6a89a-03c2-4352-ad1c-b50e65a34f38 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:03:46.288113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d1e6a89a-03c2-4352-ad1c-b50e65a34f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:03:46.356135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 647/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:03:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:03:46.379657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43644b-a8c5-4dac-8761-e51766793cf2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:46.480675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:46.488675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43644b-a8c5-4dac-8761-e51766793cf2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:46.522471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:46.523199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:46.523485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:46.523765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:46.524422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:46.525802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:03:46.538670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:03:46.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:03:46.541267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 657/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jul 21 10:03:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:03:46.546004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a89a-03c2-4352-ad1c-b50e65a34f38 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:46.624476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:46.647949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a89a-03c2-4352-ad1c-b50e65a34f38 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:46.682857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b61815-c800-4df5-9d12-61427b41944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:46.683618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61815-c800-4df5-9d12-61427b41944c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:46.684082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61815-c800-4df5-9d12-61427b41944c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:46.684491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61815-c800-4df5-9d12-61427b41944c None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:46.685934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61815-c800-4df5-9d12-61427b41944c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:03:46.687386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61815-c800-4df5-9d12-61427b41944c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:46.689869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61815-c800-4df5-9d12-61427b41944c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:46.696152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 648/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jul 21 10:03:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:03:46.701964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:03:46.802033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bb1f8-b623-4fdb-955b-eecfcc466833 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:03:46.835724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887fecb-fc78-4ee1-b4ce-28081809e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:03:46.836385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887fecb-fc78-4ee1-b4ce-28081809e6bc None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:03:46.836670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887fecb-fc78-4ee1-b4ce-28081809e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:03:46.836943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887fecb-fc78-4ee1-b4ce-28081809e6bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:03:46.837690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887fecb-fc78-4ee1-b4ce-28081809e6bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:03:46.839344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887fecb-fc78-4ee1-b4ce-28081809e6bc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:03:46.857525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 658/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jul 21 10:03:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:03:56.693004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=30 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:03:56.853301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:04:52.514762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637fdc7-5931-47bc-9c62-5195ef25e4cb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:52.515340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637fdc7-5931-47bc-9c62-5195ef25e4cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:52.515340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637fdc7-5931-47bc-9c62-5195ef25e4cb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:52.521703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 649/1307] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:04:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:04:52.523705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed227e3-45b1-4f78-a877-f792c40902d6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:52.524564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed227e3-45b1-4f78-a877-f792c40902d6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:52.525063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed227e3-45b1-4f78-a877-f792c40902d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:52.620955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bed227e3-45b1-4f78-a877-f792c40902d6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:04:52.623300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bed227e3-45b1-4f78-a877-f792c40902d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:52.870203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 659/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:04:52.919695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3a11d-5b55-454f-a013-585e76deb24b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:52.920330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3a11d-5b55-454f-a013-585e76deb24b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:52.920848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3a11d-5b55-454f-a013-585e76deb24b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:52.922822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 650/1309] 10.222.0.23 () {54 vars in 965 bytes} [Thu Jul 21 10:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:04:52.930962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d7b46-f8a4-4bcc-8d86-52c13d3d9c94 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:52.931349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d7b46-f8a4-4bcc-8d86-52c13d3d9c94 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:52.931912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d7b46-f8a4-4bcc-8d86-52c13d3d9c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:53.037404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-457d7b46-f8a4-4bcc-8d86-52c13d3d9c94 None None] MFA Rules not processed for user `dc579eaf4c3e4ea5a77063ba5f3d4b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:04:53.039583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-457d7b46-f8a4-4bcc-8d86-52c13d3d9c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:53.072634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:04:53.175035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 660/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Jul 21 10:04:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:04:53.186788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3a11d-5b55-454f-a013-585e76deb24b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:04:53.189156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3dd3a11d-5b55-454f-a013-585e76deb24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:53.314873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3a11d-5b55-454f-a013-585e76deb24b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:04:53.394366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962429b3-d94d-4274-bb0c-e612baaff545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:04:53.395034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962429b3-d94d-4274-bb0c-e612baaff545 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:53.395326 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962429b3-d94d-4274-bb0c-e612baaff545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:53.395600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962429b3-d94d-4274-bb0c-e612baaff545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:53.397279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-962429b3-d94d-4274-bb0c-e612baaff545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:53.464840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:04:53.541068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962429b3-d94d-4274-bb0c-e612baaff545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:04:53.542565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962429b3-d94d-4274-bb0c-e612baaff545 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:04:53.572817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 651/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:04:55.968648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af1ef-d1d9-40af-902b-37dd032b3d55 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:55.969177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af1ef-d1d9-40af-902b-37dd032b3d55 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:55.969177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af1ef-d1d9-40af-902b-37dd032b3d55 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:55.971141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 661/1312] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:04:55.976887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b5a2-2223-4d62-b156-6cfc73a351d3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:55.976887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b5a2-2223-4d62-b156-6cfc73a351d3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:55.977372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b5a2-2223-4d62-b156-6cfc73a351d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:56.050189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ae19b5a2-2223-4d62-b156-6cfc73a351d3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:04:56.051416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ae19b5a2-2223-4d62-b156-6cfc73a351d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:56.147333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 652/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:04:56.185714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af1ef-d1d9-40af-902b-37dd032b3d55 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:04:56.187267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-631af1ef-d1d9-40af-902b-37dd032b3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:56.288237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af1ef-d1d9-40af-902b-37dd032b3d55 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:04:56.357467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:04:56.360202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a175-2b22-4707-a380-16a6778020b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:04:56.360957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a175-2b22-4707-a380-16a6778020b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:56.361469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a175-2b22-4707-a380-16a6778020b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:56.361941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a175-2b22-4707-a380-16a6778020b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:56.363896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2ef6a175-2b22-4707-a380-16a6778020b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:56.470244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6a175-2b22-4707-a380-16a6778020b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:04:56.472423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6a175-2b22-4707-a380-16a6778020b3 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:04:56.490699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 662/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:04:58.908483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9ed1-88fb-430f-b134-60f4f3b8134a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:58.909030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9ed1-88fb-430f-b134-60f4f3b8134a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:58.909030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9ed1-88fb-430f-b134-60f4f3b8134a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:58.910431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 653/1315] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:04:58.915735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1117d-74d1-41b3-bdaf-f9ed37bcf3a0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:58.916196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1117d-74d1-41b3-bdaf-f9ed37bcf3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:58.916301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1117d-74d1-41b3-bdaf-f9ed37bcf3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:58.983213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8ba1117d-74d1-41b3-bdaf-f9ed37bcf3a0 None None] MFA Rules not processed for user `de0861b677d84f47aa0c0c38eb090876`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:04:58.984422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ba1117d-74d1-41b3-bdaf-f9ed37bcf3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:59.038083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:04:59.085891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 663/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:04:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:04:59.126381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9ed1-88fb-430f-b134-60f4f3b8134a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:04:59.128580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-121c9ed1-88fb-430f-b134-60f4f3b8134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:59.138439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:04:59.233563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9ed1-88fb-430f-b134-60f4f3b8134a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:04:59.310066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ce3bc-f103-4962-bdd9-3a42566fd973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:04:59.310747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce3bc-f103-4962-bdd9-3a42566fd973 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:04:59.311026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce3bc-f103-4962-bdd9-3a42566fd973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:04:59.311297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce3bc-f103-4962-bdd9-3a42566fd973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:04:59.313039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-419ce3bc-f103-4962-bdd9-3a42566fd973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:04:59.377900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:04:59.424701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ce3bc-f103-4962-bdd9-3a42566fd973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:04:59.426266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ce3bc-f103-4962-bdd9-3a42566fd973 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:04:59.444435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 654/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:02.061381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb03e-6cff-4ab5-88a8-e3f44c04f124 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:02.061897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb03e-6cff-4ab5-88a8-e3f44c04f124 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:02.061992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb03e-6cff-4ab5-88a8-e3f44c04f124 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:02.063308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 664/1318] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:02.068385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fbc8e-3194-4475-9cdb-124dd0e3d8cd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:02.068856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fbc8e-3194-4475-9cdb-124dd0e3d8cd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:02.068955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fbc8e-3194-4475-9cdb-124dd0e3d8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:02.138003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ea4fbc8e-3194-4475-9cdb-124dd0e3d8cd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:02.139245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ea4fbc8e-3194-4475-9cdb-124dd0e3d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:02.237796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 655/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:02.278163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acb03e-6cff-4ab5-88a8-e3f44c04f124 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:02.279736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b6acb03e-6cff-4ab5-88a8-e3f44c04f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:02.381668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acb03e-6cff-4ab5-88a8-e3f44c04f124 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:02.457988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0311c-cdff-4698-a369-b6e6b639c284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:02.458666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0311c-cdff-4698-a369-b6e6b639c284 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:02.458956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0311c-cdff-4698-a369-b6e6b639c284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:02.459236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0311c-cdff-4698-a369-b6e6b639c284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:02.460885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-27a0311c-cdff-4698-a369-b6e6b639c284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:02.474003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:02.568756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0311c-cdff-4698-a369-b6e6b639c284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:02.570257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0311c-cdff-4698-a369-b6e6b639c284 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:02.588353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 665/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:05.274277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df48e1-5fac-4044-b973-69905200a82a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:05.274852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df48e1-5fac-4044-b973-69905200a82a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:05.274951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df48e1-5fac-4044-b973-69905200a82a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:05.276262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 656/1321] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:05.281572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6c2c-b49a-465b-af4a-24b985691bdf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:05.281959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6c2c-b49a-465b-af4a-24b985691bdf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:05.282136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6c2c-b49a-465b-af4a-24b985691bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:05.348620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b0cc6c2c-b49a-465b-af4a-24b985691bdf None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:05.349838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0cc6c2c-b49a-465b-af4a-24b985691bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:05.406465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:05.450535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 666/1322] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:05.488332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df48e1-5fac-4044-b973-69905200a82a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:05.489892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f1df48e1-5fac-4044-b973-69905200a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:05.510421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:05.602348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df48e1-5fac-4044-b973-69905200a82a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:05.680829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121c53a-e441-48f1-84de-9149a7a2eed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:05.681487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c53a-e441-48f1-84de-9149a7a2eed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:05.681773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c53a-e441-48f1-84de-9149a7a2eed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:05.682052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c53a-e441-48f1-84de-9149a7a2eed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:05.683759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d121c53a-e441-48f1-84de-9149a7a2eed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:05.756384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:05.794002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121c53a-e441-48f1-84de-9149a7a2eed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:05.795461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121c53a-e441-48f1-84de-9149a7a2eed7 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:05.813106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 657/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:07.918849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e4be4-ecf1-4c54-99d0-23501c29409f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:07.919385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e4be4-ecf1-4c54-99d0-23501c29409f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:07.919385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e4be4-ecf1-4c54-99d0-23501c29409f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:07.920683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 667/1324] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:07.926106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026dd89-98e9-4031-94e5-229473d8dfa5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:07.926536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026dd89-98e9-4031-94e5-229473d8dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:07.926704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026dd89-98e9-4031-94e5-229473d8dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:07.993920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a026dd89-98e9-4031-94e5-229473d8dfa5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:07.995179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a026dd89-98e9-4031-94e5-229473d8dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:08.098264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 658/1325] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:08.136547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e4be4-ecf1-4c54-99d0-23501c29409f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:08.138075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d66e4be4-ecf1-4c54-99d0-23501c29409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:08.245295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e4be4-ecf1-4c54-99d0-23501c29409f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:08.321754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf2f9-58b7-41b6-9e25-17958d48c909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:08.322450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf2f9-58b7-41b6-9e25-17958d48c909 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:08.322733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf2f9-58b7-41b6-9e25-17958d48c909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:08.323008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf2f9-58b7-41b6-9e25-17958d48c909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:08.324746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fc7bf2f9-58b7-41b6-9e25-17958d48c909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:08.343712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:08.437540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf2f9-58b7-41b6-9e25-17958d48c909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:08.439008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf2f9-58b7-41b6-9e25-17958d48c909 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:08.458055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 668/1326] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:10.577117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65eb45-5fb5-46b2-a40d-1f344c662283 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:10.577691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65eb45-5fb5-46b2-a40d-1f344c662283 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:10.577691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65eb45-5fb5-46b2-a40d-1f344c662283 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:10.579080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 659/1327] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:10.584924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e1bc-3270-4df3-a58a-ed2d0610a0f1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:10.585382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e1bc-3270-4df3-a58a-ed2d0610a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:10.585473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e1bc-3270-4df3-a58a-ed2d0610a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:10.655071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b737e1bc-3270-4df3-a58a-ed2d0610a0f1 None None] MFA Rules not processed for user `de0861b677d84f47aa0c0c38eb090876`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:10.656252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b737e1bc-3270-4df3-a58a-ed2d0610a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:10.728672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:10.777605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 669/1328] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:10.832261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c358b6-cf23-4545-be6b-e5ca9ba5013e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:10.832536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c358b6-cf23-4545-be6b-e5ca9ba5013e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:10.832812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c358b6-cf23-4545-be6b-e5ca9ba5013e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:10.834208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 660/1329] 10.222.0.23 () {54 vars in 965 bytes} [Thu Jul 21 10:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:10.840580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd6165-b20d-44f1-a06c-2da490f5d72c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:10.840869 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd6165-b20d-44f1-a06c-2da490f5d72c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:10.841146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd6165-b20d-44f1-a06c-2da490f5d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:10.914549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-66fd6165-b20d-44f1-a06c-2da490f5d72c None None] MFA Rules not processed for user `dc579eaf4c3e4ea5a77063ba5f3d4b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:10.915660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-66fd6165-b20d-44f1-a06c-2da490f5d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:10.992765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 670/1330] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Jul 21 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:11.001606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c358b6-cf23-4545-be6b-e5ca9ba5013e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:11.003754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63c358b6-cf23-4545-be6b-e5ca9ba5013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:11.034390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:11.107119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c358b6-cf23-4545-be6b-e5ca9ba5013e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:11.200760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5583-fef0-4980-8afb-a40ec86189b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:11.201470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5583-fef0-4980-8afb-a40ec86189b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:11.201748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5583-fef0-4980-8afb-a40ec86189b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:11.202019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5583-fef0-4980-8afb-a40ec86189b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:11.203729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ef3b5583-fef0-4980-8afb-a40ec86189b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:11.287450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:11.320417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5583-fef0-4980-8afb-a40ec86189b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:11.321867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5583-fef0-4980-8afb-a40ec86189b8 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:11.341003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 661/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:14.035098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c36b95-a8a2-441a-b309-8cdc7a831589 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:14.035606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c36b95-a8a2-441a-b309-8cdc7a831589 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:14.035701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c36b95-a8a2-441a-b309-8cdc7a831589 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:14.037161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 671/1332] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:14.042533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4237-7a68-4df5-8cba-ac153a7a21a8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:14.042938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4237-7a68-4df5-8cba-ac153a7a21a8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:14.043078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4237-7a68-4df5-8cba-ac153a7a21a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:14.110579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d4bd4237-7a68-4df5-8cba-ac153a7a21a8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:14.112450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d4bd4237-7a68-4df5-8cba-ac153a7a21a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:14.215876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 662/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:14.252136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c36b95-a8a2-441a-b309-8cdc7a831589 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:14.253598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-29c36b95-a8a2-441a-b309-8cdc7a831589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:14.323288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:14.357840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c36b95-a8a2-441a-b309-8cdc7a831589 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:14.435742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c6c8c-9331-46e8-8962-3a0f7f3e5cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:14.436402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6c8c-9331-46e8-8962-3a0f7f3e5cce service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:14.436686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6c8c-9331-46e8-8962-3a0f7f3e5cce service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:14.436961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6c8c-9331-46e8-8962-3a0f7f3e5cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:14.438660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d5c6c8c-9331-46e8-8962-3a0f7f3e5cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:14.545688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c6c8c-9331-46e8-8962-3a0f7f3e5cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:14.547147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c6c8c-9331-46e8-8962-3a0f7f3e5cce service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:14.556923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:14.565998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 672/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:16.659752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aeb78-721d-41d3-a10a-f7d7c0b52c6c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:16.660404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aeb78-721d-41d3-a10a-f7d7c0b52c6c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:16.660404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aeb78-721d-41d3-a10a-f7d7c0b52c6c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:16.661690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 663/1335] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:16.667036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6bfc-55de-4956-a45a-1006a504690e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:16.667464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6bfc-55de-4956-a45a-1006a504690e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:16.667586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6bfc-55de-4956-a45a-1006a504690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:16.731551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ddad6bfc-55de-4956-a45a-1006a504690e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:16.732760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ddad6bfc-55de-4956-a45a-1006a504690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:16.826373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 673/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:16.866717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7aeb78-721d-41d3-a10a-f7d7c0b52c6c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:16.868251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-de7aeb78-721d-41d3-a10a-f7d7c0b52c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:16.907265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:16.971838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7aeb78-721d-41d3-a10a-f7d7c0b52c6c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:17.043863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797818-fd88-4c23-bcf9-a43497367242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:17.044522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797818-fd88-4c23-bcf9-a43497367242 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:17.044809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797818-fd88-4c23-bcf9-a43497367242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:17.045089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797818-fd88-4c23-bcf9-a43497367242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:17.046782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c9797818-fd88-4c23-bcf9-a43497367242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:17.136124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:17.162348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797818-fd88-4c23-bcf9-a43497367242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:17.163792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797818-fd88-4c23-bcf9-a43497367242 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:17.181405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 664/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:19.553663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9e40-11b4-43ad-a51e-859b24d7a2f7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:19.554285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9e40-11b4-43ad-a51e-859b24d7a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:19.554285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9e40-11b4-43ad-a51e-859b24d7a2f7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:19.555609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 674/1338] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:19.561010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f82fb-ad29-4c3b-a942-fffe12f31735 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:19.561491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f82fb-ad29-4c3b-a942-fffe12f31735 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:19.561598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f82fb-ad29-4c3b-a942-fffe12f31735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:19.632503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-462f82fb-ad29-4c3b-a942-fffe12f31735 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:19.633745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-462f82fb-ad29-4c3b-a942-fffe12f31735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:19.732908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 665/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:19.770320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d9e40-11b4-43ad-a51e-859b24d7a2f7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:19.771870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-325d9e40-11b4-43ad-a51e-859b24d7a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:19.849454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:19.877752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d9e40-11b4-43ad-a51e-859b24d7a2f7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:19.951437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5a2e1-0e37-4f09-84d8-636d42df1c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:19.952097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a2e1-0e37-4f09-84d8-636d42df1c77 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:19.952381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a2e1-0e37-4f09-84d8-636d42df1c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:19.952660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a2e1-0e37-4f09-84d8-636d42df1c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:19.954367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d2b5a2e1-0e37-4f09-84d8-636d42df1c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:20.067795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5a2e1-0e37-4f09-84d8-636d42df1c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:20.069232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5a2e1-0e37-4f09-84d8-636d42df1c77 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:20.089063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 675/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:24.172591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f28c-3081-40f3-9625-a96cf2467d20 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:24.173169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f28c-3081-40f3-9625-a96cf2467d20 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:24.173169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f28c-3081-40f3-9625-a96cf2467d20 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:24.175042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 666/1341] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:24.180344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813090-d6b5-4858-ab1c-69ccf941c7ab None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:24.180784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813090-d6b5-4858-ab1c-69ccf941c7ab None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:24.180890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813090-d6b5-4858-ab1c-69ccf941c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:24.185097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:24.253243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-da813090-d6b5-4858-ab1c-69ccf941c7ab None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:24.254543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-da813090-d6b5-4858-ab1c-69ccf941c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:24.355978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 676/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:24.395503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f28c-3081-40f3-9625-a96cf2467d20 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:24.397039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a3d1f28c-3081-40f3-9625-a96cf2467d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:24.447315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:24.506507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f28c-3081-40f3-9625-a96cf2467d20 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:24.582815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a5864-2050-4859-83c0-1ac4322dc817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:24.583468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5864-2050-4859-83c0-1ac4322dc817 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:24.583751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5864-2050-4859-83c0-1ac4322dc817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:24.584025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5864-2050-4859-83c0-1ac4322dc817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:24.585692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2d4a5864-2050-4859-83c0-1ac4322dc817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:24.681836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:24.698821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a5864-2050-4859-83c0-1ac4322dc817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:24.700186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a5864-2050-4859-83c0-1ac4322dc817 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:24.719386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 667/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:27.402955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814483-4871-4747-8391-9b54ce1cb27f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:27.403543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814483-4871-4747-8391-9b54ce1cb27f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:27.403543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814483-4871-4747-8391-9b54ce1cb27f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:27.404899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 677/1344] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:27.411108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666307-0d59-4aeb-b8b2-e43e16ab63fd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:27.411708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666307-0d59-4aeb-b8b2-e43e16ab63fd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:27.411708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666307-0d59-4aeb-b8b2-e43e16ab63fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:27.484454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-62666307-0d59-4aeb-b8b2-e43e16ab63fd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:27.485666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62666307-0d59-4aeb-b8b2-e43e16ab63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:27.584949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 668/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:27.622983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814483-4871-4747-8391-9b54ce1cb27f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:27.624516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2c814483-4871-4747-8391-9b54ce1cb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:27.710324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:27.728662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814483-4871-4747-8391-9b54ce1cb27f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:27.801382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd91c5-e6eb-4b7e-9bcb-cafeda3729da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:27.802036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd91c5-e6eb-4b7e-9bcb-cafeda3729da service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:27.802367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd91c5-e6eb-4b7e-9bcb-cafeda3729da service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:27.802647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd91c5-e6eb-4b7e-9bcb-cafeda3729da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:27.804294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1ccd91c5-e6eb-4b7e-9bcb-cafeda3729da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:27.913881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd91c5-e6eb-4b7e-9bcb-cafeda3729da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:27.915343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd91c5-e6eb-4b7e-9bcb-cafeda3729da service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:27.933126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 678/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:32.074338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76034-7fa6-4b85-a259-a203c0a22a0c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:32.074902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76034-7fa6-4b85-a259-a203c0a22a0c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:32.074902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76034-7fa6-4b85-a259-a203c0a22a0c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:32.077656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 669/1347] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:32.083068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba831c-245c-4ecd-893c-bb3f91ecd5f3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:32.083584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba831c-245c-4ecd-893c-bb3f91ecd5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:32.083949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba831c-245c-4ecd-893c-bb3f91ecd5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:32.102142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:32.176612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f7ba831c-245c-4ecd-893c-bb3f91ecd5f3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:32.178659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f7ba831c-245c-4ecd-893c-bb3f91ecd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:32.316828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 679/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:32.358747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76034-7fa6-4b85-a259-a203c0a22a0c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:32.360359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-45c76034-7fa6-4b85-a259-a203c0a22a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:32.430362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:32.483148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76034-7fa6-4b85-a259-a203c0a22a0c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:32.575788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bbb6c-69ea-40ab-8590-1ed0159610ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:32.576444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bbb6c-69ea-40ab-8590-1ed0159610ac service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:32.576744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bbb6c-69ea-40ab-8590-1ed0159610ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:32.576999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bbb6c-69ea-40ab-8590-1ed0159610ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:32.578722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-918bbb6c-69ea-40ab-8590-1ed0159610ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:32.706977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:32.711033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bbb6c-69ea-40ab-8590-1ed0159610ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:32.712916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bbb6c-69ea-40ab-8590-1ed0159610ac service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:32.732802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 670/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:37.816991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4dc8-9efa-47c1-b95f-72e5bceae164 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:37.817456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4dc8-9efa-47c1-b95f-72e5bceae164 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:37.817652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4dc8-9efa-47c1-b95f-72e5bceae164 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:37.819714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 680/1350] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:37.825402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ca035-8763-49b5-89f8-17cb6994aacd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:37.825843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ca035-8763-49b5-89f8-17cb6994aacd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:37.825993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ca035-8763-49b5-89f8-17cb6994aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:37.955515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ee6ca035-8763-49b5-89f8-17cb6994aacd None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:37.958218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ee6ca035-8763-49b5-89f8-17cb6994aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:38.097581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 671/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:42.314645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=59 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:42.498049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf1ea-ad1c-4118-b1f4-9f4a4e5e16dd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:42.498049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf1ea-ad1c-4118-b1f4-9f4a4e5e16dd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:42.498247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf1ea-ad1c-4118-b1f4-9f4a4e5e16dd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:42.501040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 681/1352] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:05:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:42.507232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74b1c-c5a3-4ef6-a426-58080133dacf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:42.507741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74b1c-c5a3-4ef6-a426-58080133dacf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:42.507834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74b1c-c5a3-4ef6-a426-58080133dacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:42.567088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:42.595114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-34c74b1c-c5a3-4ef6-a426-58080133dacf None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:42.597017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-34c74b1c-c5a3-4ef6-a426-58080133dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:42.718025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 672/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:43.824781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c0b8-1e3c-41aa-aaa9-b35020476694 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:43.825395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c0b8-1e3c-41aa-aaa9-b35020476694 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:43.825395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c0b8-1e3c-41aa-aaa9-b35020476694 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:43.826951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 682/1354] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:43.832770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2adea-27b5-4391-a5ad-6d674d823f88 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:43.833317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2adea-27b5-4391-a5ad-6d674d823f88 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:43.833412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2adea-27b5-4391-a5ad-6d674d823f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:43.911159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-74d2adea-27b5-4391-a5ad-6d674d823f88 None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:43.912312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-74d2adea-27b5-4391-a5ad-6d674d823f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:43.956969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:44.032328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 673/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:05:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:47.937522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fa3e-4cc4-4c8c-ad6f-ae5ead8fd382 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:47.940027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fa3e-4cc4-4c8c-ad6f-ae5ead8fd382 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:47.940027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fa3e-4cc4-4c8c-ad6f-ae5ead8fd382 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:47.944362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 683/1356] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:47.952360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55736ab-1766-4552-9ee3-33efefd7039b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:47.952851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55736ab-1766-4552-9ee3-33efefd7039b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:47.953289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55736ab-1766-4552-9ee3-33efefd7039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:48.062016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b55736ab-1766-4552-9ee3-33efefd7039b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:48.063629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b55736ab-1766-4552-9ee3-33efefd7039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:48.173291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 674/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:05:48.238531 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3e5e5-2db6-4b4d-8522-ff95c7ae5270 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:48.239018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3e5e5-2db6-4b4d-8522-ff95c7ae5270 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:48.239514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3e5e5-2db6-4b4d-8522-ff95c7ae5270 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:48.241954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 684/1358] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jul 21 10:05:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:05:48.258615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f6dc-213d-48ea-94c7-0b27adb1b249 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:48.258893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f6dc-213d-48ea-94c7-0b27adb1b249 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:48.259157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f6dc-213d-48ea-94c7-0b27adb1b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:48.287776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:48.389694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2772f6dc-213d-48ea-94c7-0b27adb1b249 None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:48.391542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2772f6dc-213d-48ea-94c7-0b27adb1b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:48.573432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 675/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jul 21 10:05:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:05:48.586508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3e5e5-2db6-4b4d-8522-ff95c7ae5270 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:48.588508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c7a3e5e5-2db6-4b4d-8522-ff95c7ae5270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:48.814294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3e5e5-2db6-4b4d-8522-ff95c7ae5270 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:48.904709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:48.959326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dac7f-3e2b-4113-ae94-245e9617e2b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:48.961287 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dac7f-3e2b-4113-ae94-245e9617e2b5 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:48.961646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dac7f-3e2b-4113-ae94-245e9617e2b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:48.962000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dac7f-3e2b-4113-ae94-245e9617e2b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:48.965761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf4dac7f-3e2b-4113-ae94-245e9617e2b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:49.083947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dac7f-3e2b-4113-ae94-245e9617e2b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:49.085633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dac7f-3e2b-4113-ae94-245e9617e2b5 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:49.113500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 685/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:05:51.661133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb646-f998-487e-890b-334e14bc64c7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:51.662382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb646-f998-487e-890b-334e14bc64c7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:51.662769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb646-f998-487e-890b-334e14bc64c7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:51.664603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 676/1361] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:51.671271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da0668-c65f-4ed9-9a21-76913cdc2be8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:51.671731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da0668-c65f-4ed9-9a21-76913cdc2be8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:51.672162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da0668-c65f-4ed9-9a21-76913cdc2be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:51.769508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-60da0668-c65f-4ed9-9a21-76913cdc2be8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:51.771310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-60da0668-c65f-4ed9-9a21-76913cdc2be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:51.816069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:51.938372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 686/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:51.977823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb646-f998-487e-890b-334e14bc64c7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:51.979381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e29bb646-f998-487e-890b-334e14bc64c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:52.056636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:52.201950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb646-f998-487e-890b-334e14bc64c7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:52.377188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0e726-55f6-47fb-a56a-36eacf9f8bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:52.378627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e726-55f6-47fb-a56a-36eacf9f8bdf service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:52.379041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e726-55f6-47fb-a56a-36eacf9f8bdf service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:52.379468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e726-55f6-47fb-a56a-36eacf9f8bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:52.381413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7ac0e726-55f6-47fb-a56a-36eacf9f8bdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:52.416059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:52.528683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0e726-55f6-47fb-a56a-36eacf9f8bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:52.531056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0e726-55f6-47fb-a56a-36eacf9f8bdf service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:52.555187 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 677/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:55.026499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a77b1-3ce8-46ce-9999-0c249a409db0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:55.027140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a77b1-3ce8-46ce-9999-0c249a409db0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:55.027140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a77b1-3ce8-46ce-9999-0c249a409db0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:55.028458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 687/1364] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:55.034456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406323f5-50ef-4414-84ee-937cd1c14292 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:55.035001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406323f5-50ef-4414-84ee-937cd1c14292 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:55.035001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406323f5-50ef-4414-84ee-937cd1c14292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:55.119030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-406323f5-50ef-4414-84ee-937cd1c14292 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:55.120307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-406323f5-50ef-4414-84ee-937cd1c14292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:55.236771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:55.247012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 678/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:55.287608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833af1-dbfb-45de-9efe-8d0fd0059464 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:55.287898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833af1-dbfb-45de-9efe-8d0fd0059464 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:55.288182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833af1-dbfb-45de-9efe-8d0fd0059464 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:55.289762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 688/1366] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jul 21 10:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:55.295637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ad4e-1408-4f6f-840a-126c0a2f816e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:55.295926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ad4e-1408-4f6f-840a-126c0a2f816e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:55.296211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ad4e-1408-4f6f-840a-126c0a2f816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:55.399319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0d14ad4e-1408-4f6f-840a-126c0a2f816e None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:55.400519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0d14ad4e-1408-4f6f-840a-126c0a2f816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:55.554306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 679/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jul 21 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:55.562320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9833af1-dbfb-45de-9efe-8d0fd0059464 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:55.563897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d9833af1-dbfb-45de-9efe-8d0fd0059464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:55.740096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9833af1-dbfb-45de-9efe-8d0fd0059464 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:55.764910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:55.879075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af9877-ce5f-412c-9482-fda6e2f631fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:55.879850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9877-ce5f-412c-9482-fda6e2f631fc service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:55.880269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9877-ce5f-412c-9482-fda6e2f631fc service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:55.880553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9877-ce5f-412c-9482-fda6e2f631fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:55.882270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-85af9877-ce5f-412c-9482-fda6e2f631fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:55.999526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af9877-ce5f-412c-9482-fda6e2f631fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:56.001667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af9877-ce5f-412c-9482-fda6e2f631fc service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:56.021918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 689/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:56.797255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae143ba-df4b-411c-99db-119ad254179d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:56.797787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae143ba-df4b-411c-99db-119ad254179d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:56.798105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae143ba-df4b-411c-99db-119ad254179d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:56.800420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 680/1369] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:56.810758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb602bf-7bad-404a-82fa-00b4ec9f8be0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:56.811322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb602bf-7bad-404a-82fa-00b4ec9f8be0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:56.811322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb602bf-7bad-404a-82fa-00b4ec9f8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:56.847704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:56.899353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6eb602bf-7bad-404a-82fa-00b4ec9f8be0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:56.900610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6eb602bf-7bad-404a-82fa-00b4ec9f8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:57.014193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 690/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:57.337824 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d70d-2d03-4afd-a3a1-2ff17bbb877f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:57.338225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d70d-2d03-4afd-a3a1-2ff17bbb877f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:57.338476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d70d-2d03-4afd-a3a1-2ff17bbb877f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:57.340009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 681/1371] 10.222.0.23 () {54 vars in 964 bytes} [Thu Jul 21 10:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:05:57.345357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b099f0-807d-450a-9ede-5645b178a53c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:57.345633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b099f0-807d-450a-9ede-5645b178a53c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:57.345918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b099f0-807d-450a-9ede-5645b178a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:57.441446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-25b099f0-807d-450a-9ede-5645b178a53c None None] MFA Rules not processed for user `efc3534120be42ce9bc7ebb6f2a8fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:57.442717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-25b099f0-807d-450a-9ede-5645b178a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:57.501312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:57.537691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 691/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Jul 21 10:05:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:57.546013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d70d-2d03-4afd-a3a1-2ff17bbb877f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:57.547563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f399d70d-2d03-4afd-a3a1-2ff17bbb877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:57.605693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:57.669752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d70d-2d03-4afd-a3a1-2ff17bbb877f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:57.744502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95da66-1cdd-4c8f-bd50-4cb7841ed425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:57.745163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95da66-1cdd-4c8f-bd50-4cb7841ed425 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:57.745489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95da66-1cdd-4c8f-bd50-4cb7841ed425 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:57.745718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95da66-1cdd-4c8f-bd50-4cb7841ed425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:57.747399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4e95da66-1cdd-4c8f-bd50-4cb7841ed425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:57.863094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:57.884982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95da66-1cdd-4c8f-bd50-4cb7841ed425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:57.886785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95da66-1cdd-4c8f-bd50-4cb7841ed425 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:57.907918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 682/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:05:58.355779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ca9cf-0a4f-4067-82ec-19e1ac2e83c7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:58.356313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ca9cf-0a4f-4067-82ec-19e1ac2e83c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:58.356313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ca9cf-0a4f-4067-82ec-19e1ac2e83c7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:58.357838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 692/1374] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:05:58.364052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5f91-5523-41e4-9ade-b7b9bc444588 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:58.364338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5f91-5523-41e4-9ade-b7b9bc444588 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:58.364615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5f91-5523-41e4-9ade-b7b9bc444588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:58.442975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-93de5f91-5523-41e4-9ade-b7b9bc444588 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:05:58.444650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93de5f91-5523-41e4-9ade-b7b9bc444588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:58.548287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 683/1375] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:05:58.595539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ca9cf-0a4f-4067-82ec-19e1ac2e83c7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:05:58.597970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bd0ca9cf-0a4f-4067-82ec-19e1ac2e83c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:58.775194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ca9cf-0a4f-4067-82ec-19e1ac2e83c7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:05:58.838545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:05:58.905098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946268e3-2e49-4d9c-bfb5-4e0a265cd781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:05:58.905670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946268e3-2e49-4d9c-bfb5-4e0a265cd781 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:05:58.905956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946268e3-2e49-4d9c-bfb5-4e0a265cd781 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:05:58.906264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946268e3-2e49-4d9c-bfb5-4e0a265cd781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:05:58.907922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-946268e3-2e49-4d9c-bfb5-4e0a265cd781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:05:59.001452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946268e3-2e49-4d9c-bfb5-4e0a265cd781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:05:59.003574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946268e3-2e49-4d9c-bfb5-4e0a265cd781 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:05:59.022737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 693/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:01.178374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665d32-91fd-4f09-8b69-f641e5e56d81 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:01.179358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665d32-91fd-4f09-8b69-f641e5e56d81 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:01.179358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665d32-91fd-4f09-8b69-f641e5e56d81 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:01.180754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 684/1377] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:01.185983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaccbc-b0d0-468b-ad8a-05bb549fb50c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:01.186586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaccbc-b0d0-468b-ad8a-05bb549fb50c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:01.186586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaccbc-b0d0-468b-ad8a-05bb549fb50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:01.265913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a6eaccbc-b0d0-468b-ad8a-05bb549fb50c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:01.267080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a6eaccbc-b0d0-468b-ad8a-05bb549fb50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:01.275008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:01.369278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 694/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:01.413410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33665d32-91fd-4f09-8b69-f641e5e56d81 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:01.414981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-33665d32-91fd-4f09-8b69-f641e5e56d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:01.480826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:01.579029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33665d32-91fd-4f09-8b69-f641e5e56d81 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:01.760906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a4aa-9924-4382-bcff-68136eeac79c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:01.761819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a4aa-9924-4382-bcff-68136eeac79c service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:01.762309 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a4aa-9924-4382-bcff-68136eeac79c service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:01.763421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a4aa-9924-4382-bcff-68136eeac79c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:01.765298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6c51a4aa-9924-4382-bcff-68136eeac79c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:01.816238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:01.891801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51a4aa-9924-4382-bcff-68136eeac79c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:01.893648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51a4aa-9924-4382-bcff-68136eeac79c service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:01.915337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 685/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:04.109178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa68a2-546c-45da-8d63-6701497d60e3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:04.109798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa68a2-546c-45da-8d63-6701497d60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:04.109798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa68a2-546c-45da-8d63-6701497d60e3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:04.111486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 695/1380] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:04.118006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12bcf0-6019-4a66-b25e-1602a438f3b9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:04.118537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12bcf0-6019-4a66-b25e-1602a438f3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:04.118643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12bcf0-6019-4a66-b25e-1602a438f3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:04.209656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0a12bcf0-6019-4a66-b25e-1602a438f3b9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:04.212321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0a12bcf0-6019-4a66-b25e-1602a438f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:04.323236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:04.331424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 686/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:04.378636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa68a2-546c-45da-8d63-6701497d60e3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:04.380281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d9aa68a2-546c-45da-8d63-6701497d60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:04.549428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:04.562253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa68a2-546c-45da-8d63-6701497d60e3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:04.731007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d8d5f-39d2-4ada-ab49-e9996029e7fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:04.731520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8d5f-39d2-4ada-ab49-e9996029e7fc service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:04.731837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8d5f-39d2-4ada-ab49-e9996029e7fc service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:04.732083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8d5f-39d2-4ada-ab49-e9996029e7fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:04.733888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-660d8d5f-39d2-4ada-ab49-e9996029e7fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:04.845765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d8d5f-39d2-4ada-ab49-e9996029e7fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:04.847429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d8d5f-39d2-4ada-ab49-e9996029e7fc service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:04.858999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:04.868559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 696/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:07.141161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8b61d-d060-4632-a0ff-a51287f2d5d7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:07.142117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8b61d-d060-4632-a0ff-a51287f2d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:07.142901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8b61d-d060-4632-a0ff-a51287f2d5d7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:07.145485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 687/1383] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:07.151545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728bd9f-92a6-4dfa-9e4b-23860b0f8df2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:07.152140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728bd9f-92a6-4dfa-9e4b-23860b0f8df2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:07.152140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728bd9f-92a6-4dfa-9e4b-23860b0f8df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:07.251345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5728bd9f-92a6-4dfa-9e4b-23860b0f8df2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:07.253436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5728bd9f-92a6-4dfa-9e4b-23860b0f8df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:07.398884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 697/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:07.453799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8b61d-d060-4632-a0ff-a51287f2d5d7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:07.455595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62c8b61d-d060-4632-a0ff-a51287f2d5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:07.662109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8b61d-d060-4632-a0ff-a51287f2d5d7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:07.747362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:07.799200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f33d4-02f9-40a7-be30-b9b0cd8e372f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:07.800455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f33d4-02f9-40a7-be30-b9b0cd8e372f service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:07.800787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f33d4-02f9-40a7-be30-b9b0cd8e372f service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:07.801046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f33d4-02f9-40a7-be30-b9b0cd8e372f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:07.802970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-207f33d4-02f9-40a7-be30-b9b0cd8e372f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:07.920801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f33d4-02f9-40a7-be30-b9b0cd8e372f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:07.922355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f33d4-02f9-40a7-be30-b9b0cd8e372f service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:07.942320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 688/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:10.242236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45446-63b1-47ca-b858-ca1abac9f647 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:10.242778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45446-63b1-47ca-b858-ca1abac9f647 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:10.243027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45446-63b1-47ca-b858-ca1abac9f647 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:10.244823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 698/1386] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:10.250137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35495-9313-48ac-84dc-22625e1235c6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:10.250744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35495-9313-48ac-84dc-22625e1235c6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:10.250744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35495-9313-48ac-84dc-22625e1235c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:10.325421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-96c35495-9313-48ac-84dc-22625e1235c6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:10.326649 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-96c35495-9313-48ac-84dc-22625e1235c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:10.360707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:10.438993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 689/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:10.484086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e45446-63b1-47ca-b858-ca1abac9f647 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:10.486143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-05e45446-63b1-47ca-b858-ca1abac9f647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:10.568701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:10.642451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e45446-63b1-47ca-b858-ca1abac9f647 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:10.778930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db2056-371d-494b-9f28-647f38d1824f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:10.779822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2056-371d-494b-9f28-647f38d1824f service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:10.780188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2056-371d-494b-9f28-647f38d1824f service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:10.780548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2056-371d-494b-9f28-647f38d1824f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:10.782806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30db2056-371d-494b-9f28-647f38d1824f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:10.831714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:10.885984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db2056-371d-494b-9f28-647f38d1824f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:10.887635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db2056-371d-494b-9f28-647f38d1824f service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:10.908073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 699/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:13.061976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42447ba6-5d5f-44a3-bf63-48591128e35b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:13.062543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42447ba6-5d5f-44a3-bf63-48591128e35b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:13.062661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42447ba6-5d5f-44a3-bf63-48591128e35b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:13.063952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 690/1389] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:13.069764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72578e-a865-4226-a72c-7805b0dac303 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:13.070217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72578e-a865-4226-a72c-7805b0dac303 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:13.070366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72578e-a865-4226-a72c-7805b0dac303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:13.136970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cc72578e-a865-4226-a72c-7805b0dac303 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:13.138207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cc72578e-a865-4226-a72c-7805b0dac303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:13.240495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 700/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:13.284757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42447ba6-5d5f-44a3-bf63-48591128e35b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:13.286415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42447ba6-5d5f-44a3-bf63-48591128e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:13.430875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42447ba6-5d5f-44a3-bf63-48591128e35b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:13.447697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:13.550935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c833a-78c4-456a-b02a-184eeabb55a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:13.551741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c833a-78c4-456a-b02a-184eeabb55a2 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:13.552022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c833a-78c4-456a-b02a-184eeabb55a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:13.552295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c833a-78c4-456a-b02a-184eeabb55a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:13.553939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-012c833a-78c4-456a-b02a-184eeabb55a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:13.644358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c833a-78c4-456a-b02a-184eeabb55a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:13.645982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c833a-78c4-456a-b02a-184eeabb55a2 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:13.665133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 691/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:13.742316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4068f-d67e-4c70-9c76-08d8f0448afe None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:13.742316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4068f-d67e-4c70-9c76-08d8f0448afe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:13.742316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4068f-d67e-4c70-9c76-08d8f0448afe None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:13.742316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 701/1392] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:13.745232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad92a5a-7dc3-42c9-ae07-c8142ec96af7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:13.745504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad92a5a-7dc3-42c9-ae07-c8142ec96af7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:13.745780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad92a5a-7dc3-42c9-ae07-c8142ec96af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:13.774029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:13.821189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9ad92a5a-7dc3-42c9-ae07-c8142ec96af7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:13.822491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9ad92a5a-7dc3-42c9-ae07-c8142ec96af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:13.924720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 692/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:13.980846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5aa6b-775b-4b8f-a1df-70ff2d7c2c2d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:13.981145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5aa6b-775b-4b8f-a1df-70ff2d7c2c2d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:13.981432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5aa6b-775b-4b8f-a1df-70ff2d7c2c2d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:13.982996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 702/1394] 10.222.0.23 () {54 vars in 966 bytes} [Thu Jul 21 10:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:13.988002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4b44-17e5-400a-86eb-20c496d83308 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:13.988300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4b44-17e5-400a-86eb-20c496d83308 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:13.988584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4b44-17e5-400a-86eb-20c496d83308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:14.066554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0b2f4b44-17e5-400a-86eb-20c496d83308 None None] MFA Rules not processed for user `164a361891274af1b20fe7b7458ecde6`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:14.067775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0b2f4b44-17e5-400a-86eb-20c496d83308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:14.115327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:14.152845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 693/1395] 10.222.0.23 () {58 vars in 1063 bytes} [Thu Jul 21 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:14.161029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5aa6b-775b-4b8f-a1df-70ff2d7c2c2d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:14.162567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e3a5aa6b-775b-4b8f-a1df-70ff2d7c2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:14.176836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:14.266437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5aa6b-775b-4b8f-a1df-70ff2d7c2c2d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:14.346512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa0b35-d6f4-4919-8855-e6eedd81984c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164a361891274af1b20fe7b7458ecde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:14.347610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa0b35-d6f4-4919-8855-e6eedd81984c service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:14.347899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa0b35-d6f4-4919-8855-e6eedd81984c service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:14.348180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa0b35-d6f4-4919-8855-e6eedd81984c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:14.349897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bfaa0b35-d6f4-4919-8855-e6eedd81984c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:14.427615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:14.477337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa0b35-d6f4-4919-8855-e6eedd81984c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:14.478630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa0b35-d6f4-4919-8855-e6eedd81984c service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:14.504252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 703/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:15.229160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f05eef-98ee-4bfa-87d4-32daf9b042ea None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:15.229679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f05eef-98ee-4bfa-87d4-32daf9b042ea None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:15.229853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f05eef-98ee-4bfa-87d4-32daf9b042ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:15.296262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-46f05eef-98ee-4bfa-87d4-32daf9b042ea None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:15.297494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-46f05eef-98ee-4bfa-87d4-32daf9b042ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:15.385742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 694/1397] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:15.438319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecc4ee-941c-4ebf-9710-e90836c24c8b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:15.438849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecc4ee-941c-4ebf-9710-e90836c24c8b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:15.438947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecc4ee-941c-4ebf-9710-e90836c24c8b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:15.440346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 704/1398] 10.222.0.23 () {54 vars in 943 bytes} [Thu Jul 21 10:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:15.446805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc05c-32ee-40d9-9575-3cc39c1f2dc0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:15.447101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc05c-32ee-40d9-9575-3cc39c1f2dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:15.447388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc05c-32ee-40d9-9575-3cc39c1f2dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:15.520446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:15.528371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-13edc05c-32ee-40d9-9575-3cc39c1f2dc0 None None] MFA Rules not processed for user `72498fa7138e4308affc50fa1b1a78fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:15.529580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-13edc05c-32ee-40d9-9575-3cc39c1f2dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:15.635811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 695/1399] 10.222.0.23 () {58 vars in 1040 bytes} [Thu Jul 21 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:15.645633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecc4ee-941c-4ebf-9710-e90836c24c8b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:15.647196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eaecc4ee-941c-4ebf-9710-e90836c24c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:15.783596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecc4ee-941c-4ebf-9710-e90836c24c8b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:15.785478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b2e2-5e06-41ba-9961-623b997f07d7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:15.785895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b2e2-5e06-41ba-9961-623b997f07d7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:15.786260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b2e2-5e06-41ba-9961-623b997f07d7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:15.787641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 696/1400] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:06:15.792955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:15.793252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:15.793650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:15.822003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:15.862339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:15.863589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:15.907057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02549dc9-630d-4a16-a51e-4d59c51c8456 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:15.907705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549dc9-630d-4a16-a51e-4d59c51c8456 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:15.908161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549dc9-630d-4a16-a51e-4d59c51c8456 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:15.908480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549dc9-630d-4a16-a51e-4d59c51c8456 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:15.911466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-02549dc9-630d-4a16-a51e-4d59c51c8456 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:15.934724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:15.975822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 697/1401] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:06:16.003294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02549dc9-630d-4a16-a51e-4d59c51c8456 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:16.004907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02549dc9-630d-4a16-a51e-4d59c51c8456 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:16.013207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 705/1402] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:06:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:06:16.021958 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:16.023671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:16.148707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe30f8-e2da-49c8-aef0-8fe7ff702ba2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:16.234692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:16.281009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ef3e5-e507-43d7-93cd-736e190ed3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:16.281671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ef3e5-e507-43d7-93cd-736e190ed3d6 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:16.281962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ef3e5-e507-43d7-93cd-736e190ed3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:16.282268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ef3e5-e507-43d7-93cd-736e190ed3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:16.284205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c26ef3e5-e507-43d7-93cd-736e190ed3d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:16.387797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ef3e5-e507-43d7-93cd-736e190ed3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:16.389400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ef3e5-e507-43d7-93cd-736e190ed3d6 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:16.409303 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 698/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:18.558135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72d7c8-0479-4b17-a415-c0aff2eabb3e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:18.558719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72d7c8-0479-4b17-a415-c0aff2eabb3e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:18.558719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72d7c8-0479-4b17-a415-c0aff2eabb3e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:18.560108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 706/1404] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:18.565684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1c95-e2e4-47f1-aa69-593b4ddbcfec None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:18.566121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1c95-e2e4-47f1-aa69-593b4ddbcfec None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:18.566121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1c95-e2e4-47f1-aa69-593b4ddbcfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:18.640936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5d7a1c95-e2e4-47f1-aa69-593b4ddbcfec None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:18.642183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5d7a1c95-e2e4-47f1-aa69-593b4ddbcfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:18.685453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:18.766274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 699/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:18.805071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72d7c8-0479-4b17-a415-c0aff2eabb3e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:18.807449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5b72d7c8-0479-4b17-a415-c0aff2eabb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:18.887906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:18.972609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72d7c8-0479-4b17-a415-c0aff2eabb3e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:19.121072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950fbcd-71ba-4a72-85da-be0291838d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:19.122334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950fbcd-71ba-4a72-85da-be0291838d83 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:19.122889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950fbcd-71ba-4a72-85da-be0291838d83 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:19.123390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950fbcd-71ba-4a72-85da-be0291838d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:19.125404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7950fbcd-71ba-4a72-85da-be0291838d83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:19.177050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:19.254966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950fbcd-71ba-4a72-85da-be0291838d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:19.256650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950fbcd-71ba-4a72-85da-be0291838d83 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:19.276175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 707/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:21.373288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015f7d-7461-40c1-853e-fa2b7893b093 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:21.374358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015f7d-7461-40c1-853e-fa2b7893b093 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:21.374662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015f7d-7461-40c1-853e-fa2b7893b093 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:21.378501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 700/1407] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:06:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:21.381480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897528-66d7-4dfd-be57-fa4225769c37 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:21.382355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897528-66d7-4dfd-be57-fa4225769c37 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:21.382858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897528-66d7-4dfd-be57-fa4225769c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:21.455836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-28897528-66d7-4dfd-be57-fa4225769c37 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:21.457312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-28897528-66d7-4dfd-be57-fa4225769c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:21.582440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 708/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:21.627403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015f7d-7461-40c1-853e-fa2b7893b093 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:21.628907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e015f7d-7461-40c1-853e-fa2b7893b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:21.804528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015f7d-7461-40c1-853e-fa2b7893b093 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:21.830180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:21.948238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e230d8-5a62-48ff-8169-3bf2ea1c25c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:21.948838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e230d8-5a62-48ff-8169-3bf2ea1c25c5 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:21.949120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e230d8-5a62-48ff-8169-3bf2ea1c25c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:21.949387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e230d8-5a62-48ff-8169-3bf2ea1c25c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:21.951064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-99e230d8-5a62-48ff-8169-3bf2ea1c25c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:22.051967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e230d8-5a62-48ff-8169-3bf2ea1c25c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:22.055008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e230d8-5a62-48ff-8169-3bf2ea1c25c5 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:22.078320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 701/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:31.580169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:32.075290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:38.572322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d191b-88ae-4835-be3e-d73f0650f2d3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:38.572881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d191b-88ae-4835-be3e-d73f0650f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:38.572881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d191b-88ae-4835-be3e-d73f0650f2d3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:38.574256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 709/1410] 10.222.0.23 () {54 vars in 918 bytes} [Thu Jul 21 10:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:38.579357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1787407-bfc2-4150-ac39-2d3a28f88f63 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:38.579832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1787407-bfc2-4150-ac39-2d3a28f88f63 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:38.579950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1787407-bfc2-4150-ac39-2d3a28f88f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:38.653360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c1787407-bfc2-4150-ac39-2d3a28f88f63 None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:38.654608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c1787407-bfc2-4150-ac39-2d3a28f88f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:38.760727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 702/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jul 21 10:06:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:38.775158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afba61-93eb-4529-8184-06626076eac7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:38.775443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afba61-93eb-4529-8184-06626076eac7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:38.775714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afba61-93eb-4529-8184-06626076eac7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:38.777118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 710/1412] 10.222.0.23 () {54 vars in 918 bytes} [Thu Jul 21 10:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:38.781738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcd473-a0c4-4da5-be27-218c18da5cbf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:38.782022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcd473-a0c4-4da5-be27-218c18da5cbf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:38.782327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcd473-a0c4-4da5-be27-218c18da5cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:38.852697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:38.855775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-61dcd473-a0c4-4da5-be27-218c18da5cbf None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:38.857471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-61dcd473-a0c4-4da5-be27-218c18da5cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:38.973339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 703/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jul 21 10:06:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:41.492567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4fe0b-9981-45bf-a06a-44103d929673 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:41.493098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4fe0b-9981-45bf-a06a-44103d929673 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:41.493098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4fe0b-9981-45bf-a06a-44103d929673 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:41.494422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:41.500270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273c227-d781-4035-bc6f-fa4ae767e23c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:41.500720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273c227-d781-4035-bc6f-fa4ae767e23c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:41.500886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273c227-d781-4035-bc6f-fa4ae767e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:41.564881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0273c227-d781-4035-bc6f-fa4ae767e23c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:41.566106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0273c227-d781-4035-bc6f-fa4ae767e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:41.620848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:41.665388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:41.714593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4fe0b-9981-45bf-a06a-44103d929673 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:41.716130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0ac4fe0b-9981-45bf-a06a-44103d929673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:41.860702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4fe0b-9981-45bf-a06a-44103d929673 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:41.932529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:41.973948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70f41e-9011-4f76-bcd2-1f0cc1f9dd5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:41.974628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f41e-9011-4f76-bcd2-1f0cc1f9dd5b service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:41.974916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f41e-9011-4f76-bcd2-1f0cc1f9dd5b service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:41.975267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f41e-9011-4f76-bcd2-1f0cc1f9dd5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:41.976901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-db70f41e-9011-4f76-bcd2-1f0cc1f9dd5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:42.075296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f41e-9011-4f76-bcd2-1f0cc1f9dd5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:42.076912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f41e-9011-4f76-bcd2-1f0cc1f9dd5b service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:42.097751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 712/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:42.991915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d8446-a479-416f-a8c6-d69617894acb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:42.992480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d8446-a479-416f-a8c6-d69617894acb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:42.992480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d8446-a479-416f-a8c6-d69617894acb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:42.993832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:42.998873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605afc8-865a-4718-be3b-dd2f4752cb5e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:42.999514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605afc8-865a-4718-be3b-dd2f4752cb5e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:42.999514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605afc8-865a-4718-be3b-dd2f4752cb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:43.072368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d605afc8-865a-4718-be3b-dd2f4752cb5e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:43.073578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d605afc8-865a-4718-be3b-dd2f4752cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:43.105423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:43.183279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:43.335569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d8446-a479-416f-a8c6-d69617894acb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:43.337087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6f8d8446-a479-416f-a8c6-d69617894acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:43.480808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d8446-a479-416f-a8c6-d69617894acb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:43.522312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:43.598528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69d729-9777-46bb-a6c8-8e9177d04bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:43.599101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69d729-9777-46bb-a6c8-8e9177d04bad service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:43.599386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69d729-9777-46bb-a6c8-8e9177d04bad service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:43.599665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69d729-9777-46bb-a6c8-8e9177d04bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:43.601339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e69d729-9777-46bb-a6c8-8e9177d04bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:43.693164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69d729-9777-46bb-a6c8-8e9177d04bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:43.694833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69d729-9777-46bb-a6c8-8e9177d04bad service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:43.712488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 706/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:44.589201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ac85-6ec2-45ee-9382-07a294ec81b3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:44.589756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ac85-6ec2-45ee-9382-07a294ec81b3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:44.589756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ac85-6ec2-45ee-9382-07a294ec81b3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:44.591172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:44.596355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08265913-2bf9-4a94-b46d-a5f64919d2e8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:44.596879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08265913-2bf9-4a94-b46d-a5f64919d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:44.597377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08265913-2bf9-4a94-b46d-a5f64919d2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:44.650900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:44.672313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-08265913-2bf9-4a94-b46d-a5f64919d2e8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:44.673615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-08265913-2bf9-4a94-b46d-a5f64919d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:44.769879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:44.925767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ac85-6ec2-45ee-9382-07a294ec81b3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:44.927354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-abb0ac85-6ec2-45ee-9382-07a294ec81b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:45.070562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ac85-6ec2-45ee-9382-07a294ec81b3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:45.082705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:45.186801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217db43-a1de-432a-8a5e-e00fd31afe26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:45.187444 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217db43-a1de-432a-8a5e-e00fd31afe26 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:45.187723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217db43-a1de-432a-8a5e-e00fd31afe26 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:45.187997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217db43-a1de-432a-8a5e-e00fd31afe26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:45.189627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4217db43-a1de-432a-8a5e-e00fd31afe26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:45.281136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217db43-a1de-432a-8a5e-e00fd31afe26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:45.282764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217db43-a1de-432a-8a5e-e00fd31afe26 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:45.301141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 715/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:46.171401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91af92-cdc8-450d-a1bc-c4eed0102841 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:46.171952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91af92-cdc8-450d-a1bc-c4eed0102841 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:46.171952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91af92-cdc8-450d-a1bc-c4eed0102841 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:46.173320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:46.178281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c93ac-2f2b-495b-9d2e-ae1aee5390fb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:46.178716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c93ac-2f2b-495b-9d2e-ae1aee5390fb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:46.178844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c93ac-2f2b-495b-9d2e-ae1aee5390fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:46.197545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:46.257816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3c6c93ac-2f2b-495b-9d2e-ae1aee5390fb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:46.259057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c6c93ac-2f2b-495b-9d2e-ae1aee5390fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:46.354542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:46.504629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91af92-cdc8-450d-a1bc-c4eed0102841 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:46.506328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-de91af92-cdc8-450d-a1bc-c4eed0102841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:46.614978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:46.653653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91af92-cdc8-450d-a1bc-c4eed0102841 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:46.764887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a497b7e-bb79-4cad-b312-39d8f5d2731b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:46.765536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a497b7e-bb79-4cad-b312-39d8f5d2731b service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:46.765816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a497b7e-bb79-4cad-b312-39d8f5d2731b service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:46.766088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a497b7e-bb79-4cad-b312-39d8f5d2731b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:46.767751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5a497b7e-bb79-4cad-b312-39d8f5d2731b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:46.841059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:46.855474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a497b7e-bb79-4cad-b312-39d8f5d2731b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:46.857068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a497b7e-bb79-4cad-b312-39d8f5d2731b service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:46.875471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 709/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:47.738628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64742-d8d1-4935-a7d2-6320a79fa7d9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:47.739227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64742-d8d1-4935-a7d2-6320a79fa7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:47.739227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64742-d8d1-4935-a7d2-6320a79fa7d9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:47.740563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:47.745714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf649c9-1fd9-41b2-9367-73249096700c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:47.746133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf649c9-1fd9-41b2-9367-73249096700c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:47.746260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf649c9-1fd9-41b2-9367-73249096700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:47.818445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bdf649c9-1fd9-41b2-9367-73249096700c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:47.819633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bdf649c9-1fd9-41b2-9367-73249096700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:47.914908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:48.064696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64742-d8d1-4935-a7d2-6320a79fa7d9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:48.066239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d0b64742-d8d1-4935-a7d2-6320a79fa7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:48.149213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:48.209834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64742-d8d1-4935-a7d2-6320a79fa7d9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:48.328409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e1058-b864-426f-b5d2-710aed454c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:48.328975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1058-b864-426f-b5d2-710aed454c13 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:48.329260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1058-b864-426f-b5d2-710aed454c13 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:48.329539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1058-b864-426f-b5d2-710aed454c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:48.331875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-980e1058-b864-426f-b5d2-710aed454c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:48.379303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:48.422304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e1058-b864-426f-b5d2-710aed454c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:48.423931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e1058-b864-426f-b5d2-710aed454c13 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:48.442256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 718/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:49.248194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed190f-bd56-4c1e-9205-307457d31200 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:49.248755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed190f-bd56-4c1e-9205-307457d31200 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:49.248755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed190f-bd56-4c1e-9205-307457d31200 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:49.250119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:49.257141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae1c7a-f290-4186-bb56-a7f8d72affbb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:49.257858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae1c7a-f290-4186-bb56-a7f8d72affbb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:49.257858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae1c7a-f290-4186-bb56-a7f8d72affbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:49.330068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b0ae1c7a-f290-4186-bb56-a7f8d72affbb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:49.331890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0ae1c7a-f290-4186-bb56-a7f8d72affbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:49.449930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:49.602068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed190f-bd56-4c1e-9205-307457d31200 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:49.603686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-55ed190f-bd56-4c1e-9205-307457d31200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:49.652682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:49.763127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed190f-bd56-4c1e-9205-307457d31200 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:49.877594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8846c-d5d8-48ea-90c3-33e0fd70f4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:49.878426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8846c-d5d8-48ea-90c3-33e0fd70f4a4 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:49.878806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8846c-d5d8-48ea-90c3-33e0fd70f4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:49.879191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8846c-d5d8-48ea-90c3-33e0fd70f4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:49.881122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e9e8846c-d5d8-48ea-90c3-33e0fd70f4a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:49.888045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:49.968597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8846c-d5d8-48ea-90c3-33e0fd70f4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:49.970474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8846c-d5d8-48ea-90c3-33e0fd70f4a4 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:49.989156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 712/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:50.799858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef549-8eb6-4ef7-9577-0c4a9fdec239 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:50.800458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef549-8eb6-4ef7-9577-0c4a9fdec239 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:50.800458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef549-8eb6-4ef7-9577-0c4a9fdec239 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:50.801798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:50.806855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f0332-809e-4fc8-8b56-618e6f6e1ef2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:50.807273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f0332-809e-4fc8-8b56-618e6f6e1ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:50.807409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f0332-809e-4fc8-8b56-618e6f6e1ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:50.881846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-273f0332-809e-4fc8-8b56-618e6f6e1ef2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:50.883084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-273f0332-809e-4fc8-8b56-618e6f6e1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:50.951500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:50.981116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:51.132660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ef549-8eb6-4ef7-9577-0c4a9fdec239 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:51.134220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-558ef549-8eb6-4ef7-9577-0c4a9fdec239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:51.151738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:51.279616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ef549-8eb6-4ef7-9577-0c4a9fdec239 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:51.379701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:51.405807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e1d96-0c4c-4ca8-bb93-c15b08db7bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:51.406503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1d96-0c4c-4ca8-bb93-c15b08db7bb8 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:51.406782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1d96-0c4c-4ca8-bb93-c15b08db7bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:51.407056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1d96-0c4c-4ca8-bb93-c15b08db7bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:51.408691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-067e1d96-0c4c-4ca8-bb93-c15b08db7bb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:51.499665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e1d96-0c4c-4ca8-bb93-c15b08db7bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:51.501283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e1d96-0c4c-4ca8-bb93-c15b08db7bb8 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:51.519070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 721/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:52.322708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4671ab-1154-4f4c-9e04-e7539f37ee63 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:52.323235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4671ab-1154-4f4c-9e04-e7539f37ee63 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:52.323235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4671ab-1154-4f4c-9e04-e7539f37ee63 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:52.324611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:52.329679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db082e-b781-441f-a0a5-119775ef71c3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:52.330097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db082e-b781-441f-a0a5-119775ef71c3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:52.330275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db082e-b781-441f-a0a5-119775ef71c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:52.403977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-74db082e-b781-441f-a0a5-119775ef71c3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:52.405184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-74db082e-b781-441f-a0a5-119775ef71c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:52.446533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:52.501360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:52.652408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4671ab-1154-4f4c-9e04-e7539f37ee63 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:52.653837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9f4671ab-1154-4f4c-9e04-e7539f37ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:52.807543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4671ab-1154-4f4c-9e04-e7539f37ee63 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:52.860972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:52.918433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2dcd3-d26b-483e-a25e-dd5e6527517d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:52.919012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2dcd3-d26b-483e-a25e-dd5e6527517d service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:52.919292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2dcd3-d26b-483e-a25e-dd5e6527517d service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:52.919565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2dcd3-d26b-483e-a25e-dd5e6527517d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:52.921217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5fc2dcd3-d26b-483e-a25e-dd5e6527517d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:53.012186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2dcd3-d26b-483e-a25e-dd5e6527517d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:53.013813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2dcd3-d26b-483e-a25e-dd5e6527517d service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:53.032098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 715/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:53.850758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14632e29-2236-4581-9a45-33e685b8ef48 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:53.851339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14632e29-2236-4581-9a45-33e685b8ef48 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:53.851339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14632e29-2236-4581-9a45-33e685b8ef48 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:53.852673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:53.857634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a7c7-af89-4d46-9b3f-6b7cf323d02b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:53.858043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a7c7-af89-4d46-9b3f-6b7cf323d02b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:53.858259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a7c7-af89-4d46-9b3f-6b7cf323d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:53.932028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2205a7c7-af89-4d46-9b3f-6b7cf323d02b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:53.933234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2205a7c7-af89-4d46-9b3f-6b7cf323d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:53.935282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:54.029924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:54.182071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14632e29-2236-4581-9a45-33e685b8ef48 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:54.183528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-14632e29-2236-4581-9a45-33e685b8ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:54.329708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14632e29-2236-4581-9a45-33e685b8ef48 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:54.361358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:54.452199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdaeea-1a83-4c85-acc4-168852d48172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:54.452864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdaeea-1a83-4c85-acc4-168852d48172 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:54.453150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdaeea-1a83-4c85-acc4-168852d48172 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:54.453426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdaeea-1a83-4c85-acc4-168852d48172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:54.455112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cfcdaeea-1a83-4c85-acc4-168852d48172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:54.552031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdaeea-1a83-4c85-acc4-168852d48172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:54.553717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdaeea-1a83-4c85-acc4-168852d48172 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:54.572964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 724/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:56.527520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62874fe6-d9e4-4c6c-986b-7114e6033e50 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:56.528011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62874fe6-d9e4-4c6c-986b-7114e6033e50 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:56.528100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62874fe6-d9e4-4c6c-986b-7114e6033e50 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:56.529486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:56.535496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794d9a-c559-4afd-b20d-37c6b8b9704f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:56.535927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794d9a-c559-4afd-b20d-37c6b8b9704f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:56.536049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794d9a-c559-4afd-b20d-37c6b8b9704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:56.574613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:56.600457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-06794d9a-c559-4afd-b20d-37c6b8b9704f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:56.601691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-06794d9a-c559-4afd-b20d-37c6b8b9704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:56.700306 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:06:56.740204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62874fe6-d9e4-4c6c-986b-7114e6033e50 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:56.741767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62874fe6-d9e4-4c6c-986b-7114e6033e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:56.845398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62874fe6-d9e4-4c6c-986b-7114e6033e50 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:56.879185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:56.919828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26d3bf-bfc4-40cb-8cc9-9d04da18b47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:56.920469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d3bf-bfc4-40cb-8cc9-9d04da18b47d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:56.920750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d3bf-bfc4-40cb-8cc9-9d04da18b47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:56.921020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d3bf-bfc4-40cb-8cc9-9d04da18b47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:56.922689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4f26d3bf-bfc4-40cb-8cc9-9d04da18b47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:57.029155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26d3bf-bfc4-40cb-8cc9-9d04da18b47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:57.030629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26d3bf-bfc4-40cb-8cc9-9d04da18b47d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:57.048199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 718/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:06:59.242286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475df225-b46f-4511-9f80-f6806f804a7a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:59.242833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475df225-b46f-4511-9f80-f6806f804a7a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:59.242833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475df225-b46f-4511-9f80-f6806f804a7a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:59.244251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:06:59.249531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9cda-3898-4973-b4ac-d2da3e5062e0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:59.249954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9cda-3898-4973-b4ac-d2da3e5062e0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:59.250097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9cda-3898-4973-b4ac-d2da3e5062e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:59.314330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f93e9cda-3898-4973-b4ac-d2da3e5062e0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:06:59.316165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f93e9cda-3898-4973-b4ac-d2da3e5062e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:59.328689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:59.413408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:06:59.453170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475df225-b46f-4511-9f80-f6806f804a7a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:06:59.454818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-475df225-b46f-4511-9f80-f6806f804a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:59.560434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475df225-b46f-4511-9f80-f6806f804a7a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:06:59.572464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:06:59.635147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095ace2-f87f-4535-a472-89cb0b42dff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:06:59.635920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095ace2-f87f-4535-a472-89cb0b42dff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:06:59.636510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095ace2-f87f-4535-a472-89cb0b42dff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:06:59.636808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095ace2-f87f-4535-a472-89cb0b42dff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:06:59.638529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b095ace2-f87f-4535-a472-89cb0b42dff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:06:59.746017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095ace2-f87f-4535-a472-89cb0b42dff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:06:59.747399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095ace2-f87f-4535-a472-89cb0b42dff2 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:06:59.766076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 727/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:02.100570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4ec17-80bb-4b6f-8bdd-0c06ce08aad1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:02.101068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4ec17-80bb-4b6f-8bdd-0c06ce08aad1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:02.101168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4ec17-80bb-4b6f-8bdd-0c06ce08aad1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:02.102575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:02.107887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d132f7-c804-4470-aeaf-bb3178a0dfe6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:02.108317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d132f7-c804-4470-aeaf-bb3178a0dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:02.108451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d132f7-c804-4470-aeaf-bb3178a0dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:02.156199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:02.175388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f3d132f7-c804-4470-aeaf-bb3178a0dfe6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:02.176601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f3d132f7-c804-4470-aeaf-bb3178a0dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:02.270378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:02.309626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4ec17-80bb-4b6f-8bdd-0c06ce08aad1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:02.311224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9de4ec17-80bb-4b6f-8bdd-0c06ce08aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:02.413077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4ec17-80bb-4b6f-8bdd-0c06ce08aad1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:02.452455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:02.488138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a5622-e719-4103-9f10-6e89ad0cd990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:02.488793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5622-e719-4103-9f10-6e89ad0cd990 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:02.489070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5622-e719-4103-9f10-6e89ad0cd990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:02.489377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5622-e719-4103-9f10-6e89ad0cd990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:02.491081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-801a5622-e719-4103-9f10-6e89ad0cd990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:02.601564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a5622-e719-4103-9f10-6e89ad0cd990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:02.603035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a5622-e719-4103-9f10-6e89ad0cd990 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:02.621311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 721/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:04.816383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256233-1e86-434e-92b3-f27635e9aed7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:04.816967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256233-1e86-434e-92b3-f27635e9aed7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:04.817152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256233-1e86-434e-92b3-f27635e9aed7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:04.818583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:04.824186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13433b2-ea76-41e3-a72f-dd5a5e6047c7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:04.824609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13433b2-ea76-41e3-a72f-dd5a5e6047c7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:04.824750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13433b2-ea76-41e3-a72f-dd5a5e6047c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:04.888805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e13433b2-ea76-41e3-a72f-dd5a5e6047c7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:04.890001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e13433b2-ea76-41e3-a72f-dd5a5e6047c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:04.912424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:04.992543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:07:05.030411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256233-1e86-434e-92b3-f27635e9aed7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:05.031953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3e256233-1e86-434e-92b3-f27635e9aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:05.137737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256233-1e86-434e-92b3-f27635e9aed7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:05.157583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:05.210535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc3aa-ef5b-4356-8d9e-8808fcec6ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:05.211180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc3aa-ef5b-4356-8d9e-8808fcec6ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:05.211460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc3aa-ef5b-4356-8d9e-8808fcec6ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:05.211732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc3aa-ef5b-4356-8d9e-8808fcec6ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:05.213358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d0dcc3aa-ef5b-4356-8d9e-8808fcec6ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:05.319768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc3aa-ef5b-4356-8d9e-8808fcec6ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:05.321213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc3aa-ef5b-4356-8d9e-8808fcec6ab7 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:05.339368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 730/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:07.491888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76e33-22c4-49d5-a191-511ef5839d34 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:07.492798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76e33-22c4-49d5-a191-511ef5839d34 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:07.493121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76e33-22c4-49d5-a191-511ef5839d34 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:07.494615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:07.500068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0454f1-efc9-433d-809e-5ace26697fbe None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:07.500481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0454f1-efc9-433d-809e-5ace26697fbe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:07.500638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0454f1-efc9-433d-809e-5ace26697fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:07.561946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:07.564855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8f0454f1-efc9-433d-809e-5ace26697fbe None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:07.567314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f0454f1-efc9-433d-809e-5ace26697fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:07.665839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:07.704924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76e33-22c4-49d5-a191-511ef5839d34 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:07.706543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b0c76e33-22c4-49d5-a191-511ef5839d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:07.808394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76e33-22c4-49d5-a191-511ef5839d34 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:07.855403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:07.879430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadacf3-401f-4281-b3a5-1f70cca54c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:07.880071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadacf3-401f-4281-b3a5-1f70cca54c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:07.880351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadacf3-401f-4281-b3a5-1f70cca54c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:07.880619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadacf3-401f-4281-b3a5-1f70cca54c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:07.882265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6cadacf3-401f-4281-b3a5-1f70cca54c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:07.989428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadacf3-401f-4281-b3a5-1f70cca54c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:07.990885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadacf3-401f-4281-b3a5-1f70cca54c9a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:08.008352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 724/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:10.092081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748004c6-4eb9-4f1b-8380-0ec137fe7ba2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:10.092527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748004c6-4eb9-4f1b-8380-0ec137fe7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:10.092650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748004c6-4eb9-4f1b-8380-0ec137fe7ba2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:10.093999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:10.099910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065feeb-3c55-4fa9-986d-e1ef91fabb4c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:10.100390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065feeb-3c55-4fa9-986d-e1ef91fabb4c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:10.100552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065feeb-3c55-4fa9-986d-e1ef91fabb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:10.168313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7065feeb-3c55-4fa9-986d-e1ef91fabb4c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:10.169543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7065feeb-3c55-4fa9-986d-e1ef91fabb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:10.198776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:10.270398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:10.307764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748004c6-4eb9-4f1b-8380-0ec137fe7ba2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:10.309340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-748004c6-4eb9-4f1b-8380-0ec137fe7ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:10.413547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748004c6-4eb9-4f1b-8380-0ec137fe7ba2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:10.442081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:10.488213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7981f-35cb-482a-b07b-3e5a73d5d9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:10.488872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7981f-35cb-482a-b07b-3e5a73d5d9cc service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:10.489153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7981f-35cb-482a-b07b-3e5a73d5d9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:10.489460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7981f-35cb-482a-b07b-3e5a73d5d9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:10.491159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-54e7981f-35cb-482a-b07b-3e5a73d5d9cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:10.600945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7981f-35cb-482a-b07b-3e5a73d5d9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:10.602489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7981f-35cb-482a-b07b-3e5a73d5d9cc service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:10.620782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 733/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:12.741876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaaba-8571-4f99-afc8-a3f985b691b2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:12.742445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaaba-8571-4f99-afc8-a3f985b691b2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:12.742445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaaba-8571-4f99-afc8-a3f985b691b2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:12.743843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:12.749223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34445b-1cab-4f2d-997f-7f3008fa40b4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:12.749692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34445b-1cab-4f2d-997f-7f3008fa40b4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:12.749791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34445b-1cab-4f2d-997f-7f3008fa40b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:12.816068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1c34445b-1cab-4f2d-997f-7f3008fa40b4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:12.817292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1c34445b-1cab-4f2d-997f-7f3008fa40b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:12.825713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:12.913642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:12.950341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaaba-8571-4f99-afc8-a3f985b691b2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:12.952197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fa0aaaba-8571-4f99-afc8-a3f985b691b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:13.059174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaaba-8571-4f99-afc8-a3f985b691b2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:13.120952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:13.146265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747f2c0-0613-4872-a8b7-09505f915690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:13.146926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f2c0-0613-4872-a8b7-09505f915690 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:13.147201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f2c0-0613-4872-a8b7-09505f915690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:13.147478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f2c0-0613-4872-a8b7-09505f915690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:13.149190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7747f2c0-0613-4872-a8b7-09505f915690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:13.257878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747f2c0-0613-4872-a8b7-09505f915690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:13.259372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747f2c0-0613-4872-a8b7-09505f915690 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:13.277647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 727/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:15.437707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a21dc-8b23-407c-9985-dd1fce99583f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:15.438274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a21dc-8b23-407c-9985-dd1fce99583f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:15.438396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a21dc-8b23-407c-9985-dd1fce99583f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:15.439831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:15.445811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b8ec-9ddf-46bb-9158-25e7ef122189 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:15.446293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b8ec-9ddf-46bb-9158-25e7ef122189 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:15.446428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b8ec-9ddf-46bb-9158-25e7ef122189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:15.519122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d689b8ec-9ddf-46bb-9158-25e7ef122189 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:15.520335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d689b8ec-9ddf-46bb-9158-25e7ef122189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:15.559189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:15.618251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:15.655865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a21dc-8b23-407c-9985-dd1fce99583f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:15.657400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b6a21dc-8b23-407c-9985-dd1fce99583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:15.769011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a21dc-8b23-407c-9985-dd1fce99583f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:15.807869 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:15.843479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831519-e48b-40dd-b6ba-aa92c7f9240c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:15.844124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831519-e48b-40dd-b6ba-aa92c7f9240c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:15.844405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831519-e48b-40dd-b6ba-aa92c7f9240c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:15.844676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831519-e48b-40dd-b6ba-aa92c7f9240c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:15.846601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-73831519-e48b-40dd-b6ba-aa92c7f9240c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:15.954396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831519-e48b-40dd-b6ba-aa92c7f9240c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:15.955857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831519-e48b-40dd-b6ba-aa92c7f9240c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:15.974532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 736/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:18.032063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18623c0-0de8-4629-b9ea-d41629cda5a3 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:18.032849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18623c0-0de8-4629-b9ea-d41629cda5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:18.032849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18623c0-0de8-4629-b9ea-d41629cda5a3 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:18.034877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:18.040355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655ce31-8375-46cc-854b-fb67680672c1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:18.040796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655ce31-8375-46cc-854b-fb67680672c1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:18.041015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655ce31-8375-46cc-854b-fb67680672c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:18.107740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d655ce31-8375-46cc-854b-fb67680672c1 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:18.108952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d655ce31-8375-46cc-854b-fb67680672c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:18.127039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:18.207737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:18.246163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18623c0-0de8-4629-b9ea-d41629cda5a3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:18.247757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f18623c0-0de8-4629-b9ea-d41629cda5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:18.352298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18623c0-0de8-4629-b9ea-d41629cda5a3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:18.420255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:18.427787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2cd06-3935-4a91-b20f-35ade2a958b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:18.428447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cd06-3935-4a91-b20f-35ade2a958b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:18.428733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cd06-3935-4a91-b20f-35ade2a958b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:18.429010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cd06-3935-4a91-b20f-35ade2a958b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:18.430709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ecb2cd06-3935-4a91-b20f-35ade2a958b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:18.540958 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2cd06-3935-4a91-b20f-35ade2a958b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:18.542502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2cd06-3935-4a91-b20f-35ade2a958b4 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:18.566025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 730/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:20.602192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131db0-2a60-4de6-9f45-2de54f54aaad None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:20.602717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131db0-2a60-4de6-9f45-2de54f54aaad None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:20.602843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131db0-2a60-4de6-9f45-2de54f54aaad None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:20.604190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:20.609562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7caf0-3769-4663-af16-36b4aae95209 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:20.609966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7caf0-3769-4663-af16-36b4aae95209 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:20.610118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7caf0-3769-4663-af16-36b4aae95209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:20.678187 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bfc7caf0-3769-4663-af16-36b4aae95209 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:20.679494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bfc7caf0-3769-4663-af16-36b4aae95209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:20.727208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:20.775194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:20.813095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131db0-2a60-4de6-9f45-2de54f54aaad None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:20.814664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0131db0-2a60-4de6-9f45-2de54f54aaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:20.920354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131db0-2a60-4de6-9f45-2de54f54aaad None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:20.967662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:20.994083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2b29a-5f7f-4e43-aa8e-95554cf9a27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:20.994790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2b29a-5f7f-4e43-aa8e-95554cf9a27c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:20.995073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2b29a-5f7f-4e43-aa8e-95554cf9a27c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:20.995349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2b29a-5f7f-4e43-aa8e-95554cf9a27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:20.997011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09e2b29a-5f7f-4e43-aa8e-95554cf9a27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:21.107782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2b29a-5f7f-4e43-aa8e-95554cf9a27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:21.109226 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2b29a-5f7f-4e43-aa8e-95554cf9a27c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:21.129206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 739/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:30.773345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=22 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:31.125958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=66 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:40.869965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cf7dc-5523-4832-b231-7c267d45881d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:40.870551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cf7dc-5523-4832-b231-7c267d45881d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:40.870551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cf7dc-5523-4832-b231-7c267d45881d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:40.871930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 732/1471] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:40.878230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba657a0d-c731-4ebf-98d8-ab068311b01d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:40.878637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba657a0d-c731-4ebf-98d8-ab068311b01d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:40.878801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba657a0d-c731-4ebf-98d8-ab068311b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:40.943842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ba657a0d-c731-4ebf-98d8-ab068311b01d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:40.945051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ba657a0d-c731-4ebf-98d8-ab068311b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:41.041942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 740/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:41.128022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e193d2-abd5-4c5e-83b6-d62cc427929e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:41.128310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e193d2-abd5-4c5e-83b6-d62cc427929e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:41.128587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e193d2-abd5-4c5e-83b6-d62cc427929e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:41.129981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 733/1473] 10.222.0.23 () {54 vars in 966 bytes} [Thu Jul 21 10:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:41.134769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ebddf-1bde-4b82-91bc-c464564c24e3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:41.135062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ebddf-1bde-4b82-91bc-c464564c24e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:41.135346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ebddf-1bde-4b82-91bc-c464564c24e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:41.209763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-085ebddf-1bde-4b82-91bc-c464564c24e3 None None] MFA Rules not processed for user `164a361891274af1b20fe7b7458ecde6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:41.211012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-085ebddf-1bde-4b82-91bc-c464564c24e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:41.232169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:41.296447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 741/1474] 10.222.0.23 () {58 vars in 1063 bytes} [Thu Jul 21 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:41.303923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e193d2-abd5-4c5e-83b6-d62cc427929e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:41.305509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f3e193d2-abd5-4c5e-83b6-d62cc427929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:41.413502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e193d2-abd5-4c5e-83b6-d62cc427929e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:41.488641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ee6b5-f3b9-4da3-b977-3bcd06312c3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164a361891274af1b20fe7b7458ecde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:41.489290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee6b5-f3b9-4da3-b977-3bcd06312c3d service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:41.489570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee6b5-f3b9-4da3-b977-3bcd06312c3d service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:41.489842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee6b5-f3b9-4da3-b977-3bcd06312c3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:41.491528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-be2ee6b5-f3b9-4da3-b977-3bcd06312c3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:41.546975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:41.602343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ee6b5-f3b9-4da3-b977-3bcd06312c3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:41.603909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ee6b5-f3b9-4da3-b977-3bcd06312c3d service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:41.622652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 734/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:43.775290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb10b82-5dd3-4d51-aca6-3e6eb77c20f4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:43.775816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb10b82-5dd3-4d51-aca6-3e6eb77c20f4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:43.775816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb10b82-5dd3-4d51-aca6-3e6eb77c20f4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:43.777135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 742/1476] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:43.782419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c1bc-ccea-4dc5-b9d2-1267b2fd4e47 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:43.782820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c1bc-ccea-4dc5-b9d2-1267b2fd4e47 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:43.782975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c1bc-ccea-4dc5-b9d2-1267b2fd4e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:43.847897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-edb1c1bc-ccea-4dc5-b9d2-1267b2fd4e47 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:43.849097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-edb1c1bc-ccea-4dc5-b9d2-1267b2fd4e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:43.946201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 735/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:43.969580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb10b82-5dd3-4d51-aca6-3e6eb77c20f4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:43.972278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0cb10b82-5dd3-4d51-aca6-3e6eb77c20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:44.101541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb10b82-5dd3-4d51-aca6-3e6eb77c20f4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:44.151330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:44.196529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0a135-c78b-420e-b5b9-a511b92f12d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:44.197191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0a135-c78b-420e-b5b9-a511b92f12d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:44.197469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0a135-c78b-420e-b5b9-a511b92f12d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:44.197742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0a135-c78b-420e-b5b9-a511b92f12d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:44.198516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0a135-c78b-420e-b5b9-a511b92f12d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:44.200333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-6df0a135-c78b-420e-b5b9-a511b92f12d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:07:44.200333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:07:44.200333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:07:44.201460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0a135-c78b-420e-b5b9-a511b92f12d7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:44.220032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 743/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jul 21 10:07:43 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:07:46.309667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649da3-3a2c-4b8e-95ec-4595400482cc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:46.310233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649da3-3a2c-4b8e-95ec-4595400482cc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:46.310366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649da3-3a2c-4b8e-95ec-4595400482cc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:46.311774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 736/1479] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:07:46.318733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec238bbb-a6b2-4eec-ad7f-f1be204e6b95 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:46.319230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec238bbb-a6b2-4eec-ad7f-f1be204e6b95 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:46.319335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec238bbb-a6b2-4eec-ad7f-f1be204e6b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:46.383326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ec238bbb-a6b2-4eec-ad7f-f1be204e6b95 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:46.384527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ec238bbb-a6b2-4eec-ad7f-f1be204e6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:46.483147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 744/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:46.526704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649da3-3a2c-4b8e-95ec-4595400482cc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:46.528334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-00649da3-3a2c-4b8e-95ec-4595400482cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:46.539007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:46.679860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649da3-3a2c-4b8e-95ec-4595400482cc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:46.758185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:46.790883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c6bec-c043-4897-9eda-6f4fb325343f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:46.791531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6bec-c043-4897-9eda-6f4fb325343f service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:46.791837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6bec-c043-4897-9eda-6f4fb325343f service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:46.792110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6bec-c043-4897-9eda-6f4fb325343f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:46.793768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-050c6bec-c043-4897-9eda-6f4fb325343f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:46.882407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c6bec-c043-4897-9eda-6f4fb325343f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:46.883988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c6bec-c043-4897-9eda-6f4fb325343f service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:46.903397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 737/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:49.126341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995882-633a-45f1-b0e5-6a4348189311 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:49.126915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995882-633a-45f1-b0e5-6a4348189311 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:49.126915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995882-633a-45f1-b0e5-6a4348189311 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:49.128320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 745/1482] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:49.133729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc3b76-d1a3-4ac7-a2e5-2fb455aed53c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:49.134204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc3b76-d1a3-4ac7-a2e5-2fb455aed53c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:49.134330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc3b76-d1a3-4ac7-a2e5-2fb455aed53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:49.199712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-08fc3b76-d1a3-4ac7-a2e5-2fb455aed53c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:49.200933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-08fc3b76-d1a3-4ac7-a2e5-2fb455aed53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:49.251656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:49.303587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 738/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:49.340453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995882-633a-45f1-b0e5-6a4348189311 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:49.342011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f2995882-633a-45f1-b0e5-6a4348189311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:49.366860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:49.452399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995882-633a-45f1-b0e5-6a4348189311 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:49.529989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92ef4-5a77-454e-b049-0c5a1f960a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:49.530669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92ef4-5a77-454e-b049-0c5a1f960a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:49.530953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92ef4-5a77-454e-b049-0c5a1f960a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:49.531225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92ef4-5a77-454e-b049-0c5a1f960a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:49.533142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-00f92ef4-5a77-454e-b049-0c5a1f960a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:49.726988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:49.764425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92ef4-5a77-454e-b049-0c5a1f960a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:49.765877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92ef4-5a77-454e-b049-0c5a1f960a6d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:49.783681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 746/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:51.917969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ef7c-c429-4d55-98e4-1d037bd55037 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:51.918593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ef7c-c429-4d55-98e4-1d037bd55037 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:51.918593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ef7c-c429-4d55-98e4-1d037bd55037 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:51.919922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 739/1485] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:51.925188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f032-614f-4eb4-9f5a-85e9ec67de6c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:51.925631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f032-614f-4eb4-9f5a-85e9ec67de6c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:51.926402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f032-614f-4eb4-9f5a-85e9ec67de6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:51.998147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1541f032-614f-4eb4-9f5a-85e9ec67de6c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:51.999427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1541f032-614f-4eb4-9f5a-85e9ec67de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:52.097171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 747/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:52.136094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ef7c-c429-4d55-98e4-1d037bd55037 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:52.137698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c973ef7c-c429-4d55-98e4-1d037bd55037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:52.242479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ef7c-c429-4d55-98e4-1d037bd55037 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:52.319585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:52.321923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d57aa-5239-46a3-9804-b964f710da91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:52.321923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d57aa-5239-46a3-9804-b964f710da91 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:52.322285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d57aa-5239-46a3-9804-b964f710da91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:52.322521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d57aa-5239-46a3-9804-b964f710da91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:52.324862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a22d57aa-5239-46a3-9804-b964f710da91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:52.433367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d57aa-5239-46a3-9804-b964f710da91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:52.434838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d57aa-5239-46a3-9804-b964f710da91 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:52.452653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 740/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:54.652291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e810-6272-4b58-b7d1-0ad86131846e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:54.652852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e810-6272-4b58-b7d1-0ad86131846e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:54.652852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e810-6272-4b58-b7d1-0ad86131846e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:54.654293 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 748/1488] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:54.659427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e883-a78a-4c16-a722-3b028255bb70 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:54.659873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e883-a78a-4c16-a722-3b028255bb70 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:54.660009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e883-a78a-4c16-a722-3b028255bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:54.725675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e475e883-a78a-4c16-a722-3b028255bb70 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:54.726907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e475e883-a78a-4c16-a722-3b028255bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:54.777580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:54.821335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 741/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:54.861641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60e810-6272-4b58-b7d1-0ad86131846e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:54.863804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a60e810-6272-4b58-b7d1-0ad86131846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:54.898501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:54.969541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60e810-6272-4b58-b7d1-0ad86131846e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:55.042048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a32a86-0e8d-4586-b699-8b51dce36ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:55.042716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32a86-0e8d-4586-b699-8b51dce36ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:55.042997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32a86-0e8d-4586-b699-8b51dce36ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:55.043271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32a86-0e8d-4586-b699-8b51dce36ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:55.044893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d6a32a86-0e8d-4586-b699-8b51dce36ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:55.124222 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:55.153646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a32a86-0e8d-4586-b699-8b51dce36ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:55.155133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a32a86-0e8d-4586-b699-8b51dce36ab6 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:55.173798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 749/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:07:57.467498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6046-9fda-4723-ab25-891fc37dc61f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:57.468070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6046-9fda-4723-ab25-891fc37dc61f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:57.468172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6046-9fda-4723-ab25-891fc37dc61f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:57.469565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 742/1491] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jul 21 10:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:07:57.475527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ae506-1d8e-4ccc-be1b-8cfefdcec31e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:57.475970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ae506-1d8e-4ccc-be1b-8cfefdcec31e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:57.476124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ae506-1d8e-4ccc-be1b-8cfefdcec31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:57.540012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-615ae506-1d8e-4ccc-be1b-8cfefdcec31e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:07:57.541205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-615ae506-1d8e-4ccc-be1b-8cfefdcec31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:57.636426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 750/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jul 21 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:07:57.685914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6046-9fda-4723-ab25-891fc37dc61f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:07:57.687584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-31fd6046-9fda-4723-ab25-891fc37dc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:57.792104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6046-9fda-4723-ab25-891fc37dc61f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:07:57.865682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203dee-6d90-4f62-b673-725441fff1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:07:57.866363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203dee-6d90-4f62-b673-725441fff1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:07:57.866651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203dee-6d90-4f62-b673-725441fff1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:07:57.866929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203dee-6d90-4f62-b673-725441fff1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:07:57.868589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e6203dee-6d90-4f62-b673-725441fff1c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:07:57.877594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:07:57.976819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6203dee-6d90-4f62-b673-725441fff1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:07:57.978295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6203dee-6d90-4f62-b673-725441fff1c3 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:07:57.996718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 743/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:08:07.634500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=82 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:08:07.994307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=50 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:32.247232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:32.247828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:32.247828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:32.322012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:09:32.323245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:32.418432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 751/1494] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:09:32.426658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a41d5-e40a-4b8f-b98f-444857ec2f4b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:32.427462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a41d5-e40a-4b8f-b98f-444857ec2f4b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:32.427642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a41d5-e40a-4b8f-b98f-444857ec2f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:32.507398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4a1a41d5-e40a-4b8f-b98f-444857ec2f4b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:09:32.508602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4a1a41d5-e40a-4b8f-b98f-444857ec2f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:32.603969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 744/1495] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:09:32.609000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:32.610285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:32.621713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84527df5-140d-41ad-b9f9-4fb5c39a6fc5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:32.683834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:32.719194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:32.719860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:32.720139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:32.720412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:32.721130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:09:32.721435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:32.722539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:32.722539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:09:32.722539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:09:32.723609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:32.734890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 752/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:09:32.743389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a41d5-e40a-4b8f-b98f-444857ec2f4b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:32.753323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a41d5-e40a-4b8f-b98f-444857ec2f4b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:32.814716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:32.850559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:32.851231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:32.851515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:32.851791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:32.852499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:32.854323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:32.854323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) Jul 21 10:09:32.854323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: Jul 21 10:09:32.855535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:32.910717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 745/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:09:32 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:09:32.915341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:32.916844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:32.950895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa2407-a759-4158-8293-8811076ae7f5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:33.043908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:33.044578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:33.044857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:33.045128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:33.045820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:33.046859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:33.046859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:09:33.046859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:09:33.048039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:33.089628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 753/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:09:32 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:09:33.094414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:33.096295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:33.159925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b3fbd-6c16-42a5-83be-d4b7d88b90fa admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:33.245901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:33.259717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:33.260402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:33.260686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:33.260960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:33.261699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:33.262755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:33.262755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) Jul 21 10:09:33.262755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: Jul 21 10:09:33.263659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:33.276453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 746/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:09:33.280742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:33.282506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:33.293922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0176274-b6a2-48e8-8f59-fc5260646310 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:33.320239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:33.393189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1ffd1-7948-4676-a3d9-a7817daf9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:33.393900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1ffd1-7948-4676-a3d9-a7817daf9c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:33.394267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1ffd1-7948-4676-a3d9-a7817daf9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:33.394531 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1ffd1-7948-4676-a3d9-a7817daf9c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:33.395248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1ffd1-7948-4676-a3d9-a7817daf9c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:33.396312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-d6e1ffd1-7948-4676-a3d9-a7817daf9c66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:33.396312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:09:33.396312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:09:33.397199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1ffd1-7948-4676-a3d9-a7817daf9c66 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:33.409861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 754/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:09:33.414315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:33.415920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:33.451601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eb292-9c82-4ef3-ae5e-bd5bf223c24e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:33.551482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855efa75-87e2-4423-a089-d87056444ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:33.552384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855efa75-87e2-4423-a089-d87056444ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:33.552665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855efa75-87e2-4423-a089-d87056444ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:33.552937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855efa75-87e2-4423-a089-d87056444ad4 admin admin] PATH_INFO: `/v3/projects/1be6946cb149427da3045a8280af448c/users/64b7c5c51bdc4ae89095593ff286a75c/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:33.575099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855efa75-87e2-4423-a089-d87056444ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be6946cb149427da3045a8280af448c, user_id=64b7c5c51bdc4ae89095593ff286a75c, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:33.576140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-855efa75-87e2-4423-a089-d87056444ad4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:33.576140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) Jul 21 10:09:33.576140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: Jul 21 10:09:33.578071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855efa75-87e2-4423-a089-d87056444ad4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:33.611016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 747/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:09:33 2022] PUT /identity/v3/projects/1be6946cb149427da3045a8280af448c/users/64b7c5c51bdc4ae89095593ff286a75c/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:09:33.619521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5718b-762f-4115-ab1d-54b344258dc6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:33.619870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5718b-762f-4115-ab1d-54b344258dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:33.620184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5718b-762f-4115-ab1d-54b344258dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:33.683892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eca5718b-762f-4115-ab1d-54b344258dc6 None None] MFA Rules not processed for user `64b7c5c51bdc4ae89095593ff286a75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:09:33.685176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eca5718b-762f-4115-ab1d-54b344258dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:33.765854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 755/1502] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:09:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:09:33.781572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859d26-c0a7-4a08-b42e-5f4eb5c7b57f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:33.781851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859d26-c0a7-4a08-b42e-5f4eb5c7b57f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:33.782136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859d26-c0a7-4a08-b42e-5f4eb5c7b57f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:33.784055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 748/1503] 10.222.0.23 () {54 vars in 964 bytes} [Thu Jul 21 10:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:09:33.789199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6502c-f826-4c66-a734-4166b8b4dd2b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:33.789620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6502c-f826-4c66-a734-4166b8b4dd2b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:33.790010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6502c-f826-4c66-a734-4166b8b4dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:33.820952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:33.869969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-36f6502c-f826-4c66-a734-4166b8b4dd2b None None] MFA Rules not processed for user `efc3534120be42ce9bc7ebb6f2a8fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:09:33.871268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-36f6502c-f826-4c66-a734-4166b8b4dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:33.946405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 756/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Jul 21 10:09:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:09:33.954529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07859d26-c0a7-4a08-b42e-5f4eb5c7b57f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:33.956628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-07859d26-c0a7-4a08-b42e-5f4eb5c7b57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:34.008366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:34.065574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07859d26-c0a7-4a08-b42e-5f4eb5c7b57f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:34.141265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:34.141842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:34.142129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:34.142446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:34.145601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:34.253585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:34.255244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:34.258764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:34.274968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 749/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:09:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:09:34.321405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7053bd-94c9-44c9-9a96-f989beb3c177 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:34.321911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7053bd-94c9-44c9-9a96-f989beb3c177 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:34.322445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7053bd-94c9-44c9-9a96-f989beb3c177 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:34.324976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 757/1506] 10.222.0.23 () {52 vars in 829 bytes} [Thu Jul 21 10:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:09:34.329941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:34.332051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:34.444032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec8bc2-48ea-49c1-b7d9-62b108068c11 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:34.541612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:34.542525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:34.542814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:34.543089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] PATH_INFO: `/v3/users/64b7c5c51bdc4ae89095593ff286a75c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:34.556672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b7c5c51bdc4ae89095593ff286a75c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:34.557711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:34.557711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) Jul 21 10:09:34.557711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: Jul 21 10:09:34.558987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:34.569032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:34.633414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b7c5c51bdc4ae89095593ff286a75c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:34.633973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b7c5c51bdc4ae89095593ff286a75c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:34.648748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b7c5c51bdc4ae89095593ff286a75c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:34.649227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b7c5c51bdc4ae89095593ff286a75c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:34.659606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b7c5c51bdc4ae89095593ff286a75c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:34.684188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 750/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:09:34 2022] DELETE /identity/v3/users/64b7c5c51bdc4ae89095593ff286a75c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:09:34.688979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:34.689265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:34.689541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:34.747912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:09:34.749026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:34.823828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:34.838093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 758/1508] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:09:34.848869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:34.850125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:34.955372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915970-70ea-448f-a74f-830e45c42fab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:35.012056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:35.039621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bcc5f-6639-406d-bcdc-e5e2fe8b48ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:35.040281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bcc5f-6639-406d-bcdc-e5e2fe8b48ad service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:35.040558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bcc5f-6639-406d-bcdc-e5e2fe8b48ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:35.040826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bcc5f-6639-406d-bcdc-e5e2fe8b48ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:35.042531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e62bcc5f-6639-406d-bcdc-e5e2fe8b48ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:35.290096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bcc5f-6639-406d-bcdc-e5e2fe8b48ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:35.291823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bcc5f-6639-406d-bcdc-e5e2fe8b48ad service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:35.315612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 751/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:09:35.687788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:09:35.689195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:09:35.704153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69b711-14d9-43e7-95c7-390f9c6be258 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:09:35.808344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:09:35.809211 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:09:35.809494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:09:35.809869 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] PATH_INFO: `/v3/projects/1be6946cb149427da3045a8280af448c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:09:35.819879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be6946cb149427da3045a8280af448c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:09:35.820842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:09:35.820842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:09:35.820842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:09:35.822022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:09:35.881129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be6946cb149427da3045a8280af448c', 'request_id': 'req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:35.895499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be6946cb149427da3045a8280af448c', 'request_id': 'req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:35.902017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be6946cb149427da3045a8280af448c', 'request_id': 'req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:35.928894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] The token cache is being invalidate because project 1be6946cb149427da3045a8280af448c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:09:35.929176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:35.929723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e8966e4-0ece-4e3a-ae9a-f56229b73ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:09:35.931127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 759/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:09:35 2022] DELETE /identity/v3/projects/1be6946cb149427da3045a8280af448c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:09:45.312174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=62 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:09:45.926762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:11:16.614667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c9400-d8ef-4abd-bc22-9b2b3711023d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:16.615297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c9400-d8ef-4abd-bc22-9b2b3711023d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:16.615297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c9400-d8ef-4abd-bc22-9b2b3711023d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:16.616663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:16.625974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df4fc-58ea-4d03-9fee-f5884ec51f31 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:16.626593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df4fc-58ea-4d03-9fee-f5884ec51f31 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:16.626705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df4fc-58ea-4d03-9fee-f5884ec51f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:16.705340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-be3df4fc-58ea-4d03-9fee-f5884ec51f31 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:16.706607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be3df4fc-58ea-4d03-9fee-f5884ec51f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:16.814036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:11:16.967561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c9400-d8ef-4abd-bc22-9b2b3711023d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:16.969693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3b5c9400-d8ef-4abd-bc22-9b2b3711023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:17.095383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c9400-d8ef-4abd-bc22-9b2b3711023d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:17.100924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3ea3-6cd8-4b3a-869e-2a74ac5bb87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:17.101567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3ea3-6cd8-4b3a-869e-2a74ac5bb87e service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:17.101851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3ea3-6cd8-4b3a-869e-2a74ac5bb87e service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:17.102120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3ea3-6cd8-4b3a-869e-2a74ac5bb87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:17.110923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3ea3-6cd8-4b3a-869e-2a74ac5bb87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:17.112417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3ea3-6cd8-4b3a-869e-2a74ac5bb87e service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:17.121705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 753/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:17.956963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f728e5-09d1-48ff-b89e-9327890ee05e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:17.957538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f728e5-09d1-48ff-b89e-9327890ee05e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:17.957538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f728e5-09d1-48ff-b89e-9327890ee05e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:17.958981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:17.964662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60520b-fae7-4e45-9273-c6f109118838 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:17.965101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60520b-fae7-4e45-9273-c6f109118838 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:17.965213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60520b-fae7-4e45-9273-c6f109118838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:17.984298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab60520b-fae7-4e45-9273-c6f109118838 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:17.985523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab60520b-fae7-4e45-9273-c6f109118838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:17.993687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:18.145366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f728e5-09d1-48ff-b89e-9327890ee05e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:18.160172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f728e5-09d1-48ff-b89e-9327890ee05e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:18.165528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ac65-726c-474b-a1ea-83116134b51d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:18.166229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ac65-726c-474b-a1ea-83116134b51d service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:18.166489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ac65-726c-474b-a1ea-83116134b51d service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:18.166752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ac65-726c-474b-a1ea-83116134b51d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:18.174868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ac65-726c-474b-a1ea-83116134b51d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:18.176439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ac65-726c-474b-a1ea-83116134b51d service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:18.185694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 762/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:18.527495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb29f-c904-42ab-9e11-dc16c0155270 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:18.527846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb29f-c904-42ab-9e11-dc16c0155270 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:18.528134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb29f-c904-42ab-9e11-dc16c0155270 None None] PATH_INFO: `/v3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:18.529517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 755/1517] 10.222.0.40 () {54 vars in 925 bytes} [Thu Jul 21 10:11:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:11:18.538378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81edc7-bc5f-4e75-b265-bc8d915478ba None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:18.538671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81edc7-bc5f-4e75-b265-bc8d915478ba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:18.538952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81edc7-bc5f-4e75-b265-bc8d915478ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:18.602107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6d81edc7-bc5f-4e75-b265-bc8d915478ba None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:18.603427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6d81edc7-bc5f-4e75-b265-bc8d915478ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:18.620876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:11:18.676742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 763/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:27.744237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f10-502e-4d1b-adac-5638537c756d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:27.744759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f10-502e-4d1b-adac-5638537c756d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:27.744759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f10-502e-4d1b-adac-5638537c756d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:27.746094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 756/1519] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jul 21 10:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:27.751048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da41e5-cf40-4198-8a1e-386e2d59a941 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:27.751459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da41e5-cf40-4198-8a1e-386e2d59a941 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:27.751623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da41e5-cf40-4198-8a1e-386e2d59a941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:27.770143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-72da41e5-cf40-4198-8a1e-386e2d59a941 None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:27.771373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-72da41e5-cf40-4198-8a1e-386e2d59a941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:27.780577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 764/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jul 21 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:27.787942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b3f10-502e-4d1b-adac-5638537c756d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:27.801009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b3f10-502e-4d1b-adac-5638537c756d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:27.805848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83ccef-6f48-4a25-b3ac-21b34d37329d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:27.806519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ccef-6f48-4a25-b3ac-21b34d37329d service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:27.806798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ccef-6f48-4a25-b3ac-21b34d37329d service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:27.807067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ccef-6f48-4a25-b3ac-21b34d37329d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:27.815182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83ccef-6f48-4a25-b3ac-21b34d37329d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:27.816749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83ccef-6f48-4a25-b3ac-21b34d37329d service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:27.826839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 757/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:29.690257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5cfff-ae49-4d8c-b627-c374d727dcde None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:29.690821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5cfff-ae49-4d8c-b627-c374d727dcde None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:29.691167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5cfff-ae49-4d8c-b627-c374d727dcde None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:29.693362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:11:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:29.698404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239cb6-c2f1-4ebf-8821-36e35b72045b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:29.698861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239cb6-c2f1-4ebf-8821-36e35b72045b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:29.699017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239cb6-c2f1-4ebf-8821-36e35b72045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:29.717545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9c239cb6-c2f1-4ebf-8821-36e35b72045b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:29.718794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c239cb6-c2f1-4ebf-8821-36e35b72045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:29.727423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:29.881580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5cfff-ae49-4d8c-b627-c374d727dcde None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:29.897460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5cfff-ae49-4d8c-b627-c374d727dcde None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:29.903584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2f527-f466-42db-a92e-be14ceb2e7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:29.904230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f527-f466-42db-a92e-be14ceb2e7a3 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:29.904517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f527-f466-42db-a92e-be14ceb2e7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:29.904800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f527-f466-42db-a92e-be14ceb2e7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:29.913082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2f527-f466-42db-a92e-be14ceb2e7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:29.914708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2f527-f466-42db-a92e-be14ceb2e7a3 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:29.924674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 766/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:30.748989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504a41-094e-4482-b6e5-c9ed74337634 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:30.749527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504a41-094e-4482-b6e5-c9ed74337634 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:30.749527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504a41-094e-4482-b6e5-c9ed74337634 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:30.751049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:30.756282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeed3a-793b-4c8e-a68d-4a03496958d9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:30.756683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeed3a-793b-4c8e-a68d-4a03496958d9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:30.756921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeed3a-793b-4c8e-a68d-4a03496958d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:30.775776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dcfeed3a-793b-4c8e-a68d-4a03496958d9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:30.777539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dcfeed3a-793b-4c8e-a68d-4a03496958d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:30.786686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:30.938033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504a41-094e-4482-b6e5-c9ed74337634 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:30.952416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504a41-094e-4482-b6e5-c9ed74337634 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:30.958029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ccb14-72e6-4296-b6af-a4bd486aa6db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:30.958709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ccb14-72e6-4296-b6af-a4bd486aa6db service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:30.958994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ccb14-72e6-4296-b6af-a4bd486aa6db service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:30.959271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ccb14-72e6-4296-b6af-a4bd486aa6db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:30.971234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ccb14-72e6-4296-b6af-a4bd486aa6db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:30.972872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ccb14-72e6-4296-b6af-a4bd486aa6db service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:30.984205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 760/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:34.829842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899fbc9-4ec1-49a1-bfc4-1ad2f02c2c4a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:34.830459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899fbc9-4ec1-49a1-bfc4-1ad2f02c2c4a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:34.830459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899fbc9-4ec1-49a1-bfc4-1ad2f02c2c4a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:34.831812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:34.837345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2e04-0ba1-4e3e-93e6-528819047af4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:34.837799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2e04-0ba1-4e3e-93e6-528819047af4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:34.837902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2e04-0ba1-4e3e-93e6-528819047af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:34.869498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-234c2e04-0ba1-4e3e-93e6-528819047af4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:34.871250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-234c2e04-0ba1-4e3e-93e6-528819047af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:34.879298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:34.955667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899fbc9-4ec1-49a1-bfc4-1ad2f02c2c4a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:34.957392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5899fbc9-4ec1-49a1-bfc4-1ad2f02c2c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:35.047563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899fbc9-4ec1-49a1-bfc4-1ad2f02c2c4a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:35.051256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f712a-f5e0-4e15-b6fd-e169947bd170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:35.051911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f712a-f5e0-4e15-b6fd-e169947bd170 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:35.052201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f712a-f5e0-4e15-b6fd-e169947bd170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:35.052479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f712a-f5e0-4e15-b6fd-e169947bd170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:35.061607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f712a-f5e0-4e15-b6fd-e169947bd170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:35.063073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f712a-f5e0-4e15-b6fd-e169947bd170 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:35.072543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 769/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:37.130786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c597ce1-b40e-4390-8d6e-11d507673a40 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:37.131328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c597ce1-b40e-4390-8d6e-11d507673a40 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:37.131445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c597ce1-b40e-4390-8d6e-11d507673a40 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:37.132863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:37.139046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2909bf-6d09-44a0-8e0c-70b22527d62c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:37.139744 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2909bf-6d09-44a0-8e0c-70b22527d62c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:37.139986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2909bf-6d09-44a0-8e0c-70b22527d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:37.157989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6e2909bf-6d09-44a0-8e0c-70b22527d62c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:37.159227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6e2909bf-6d09-44a0-8e0c-70b22527d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:37.167205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:37.204220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c597ce1-b40e-4390-8d6e-11d507673a40 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:37.215179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c597ce1-b40e-4390-8d6e-11d507673a40 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:37.218769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd297a-4e06-4256-852f-12ea55e85197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:37.219417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd297a-4e06-4256-852f-12ea55e85197 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:37.219703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd297a-4e06-4256-852f-12ea55e85197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:37.219981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd297a-4e06-4256-852f-12ea55e85197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:37.229446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd297a-4e06-4256-852f-12ea55e85197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:37.231029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd297a-4e06-4256-852f-12ea55e85197 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:37.241191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 763/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:40.996634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c503a-fcf8-4ccc-90e5-4fd9ebee36e2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:40.997288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c503a-fcf8-4ccc-90e5-4fd9ebee36e2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:40.997288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c503a-fcf8-4ccc-90e5-4fd9ebee36e2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:40.998576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:41.004234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c5f9-858a-4bfd-bea1-7fc045fe8e0f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:41.004697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c5f9-858a-4bfd-bea1-7fc045fe8e0f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:41.004810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c5f9-858a-4bfd-bea1-7fc045fe8e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:41.023108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c9c3c5f9-858a-4bfd-bea1-7fc045fe8e0f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:41.024319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c9c3c5f9-858a-4bfd-bea1-7fc045fe8e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:41.033197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:41.346905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c503a-fcf8-4ccc-90e5-4fd9ebee36e2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:41.348605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e62c503a-fcf8-4ccc-90e5-4fd9ebee36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:41.414941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:11:41.428955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c503a-fcf8-4ccc-90e5-4fd9ebee36e2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:41.432643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161622-37c0-45ef-89d4-68b20f1aa7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:41.433293 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161622-37c0-45ef-89d4-68b20f1aa7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:41.433573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161622-37c0-45ef-89d4-68b20f1aa7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:41.433845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161622-37c0-45ef-89d4-68b20f1aa7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:41.443088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161622-37c0-45ef-89d4-68b20f1aa7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:41.444575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161622-37c0-45ef-89d4-68b20f1aa7a0 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:41.458569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 772/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:43.537134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83739f0-7fba-470f-99b7-506d283d6ca0 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:43.537674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83739f0-7fba-470f-99b7-506d283d6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:43.537674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83739f0-7fba-470f-99b7-506d283d6ca0 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:43.539082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:11:43.544349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2df9a0-5155-47e3-b0c7-b9956f9bb800 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:43.544810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2df9a0-5155-47e3-b0c7-b9956f9bb800 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:43.544955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2df9a0-5155-47e3-b0c7-b9956f9bb800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:43.563208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9f2df9a0-5155-47e3-b0c7-b9956f9bb800 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:11:43.564399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9f2df9a0-5155-47e3-b0c7-b9956f9bb800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:43.572201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:11:43.883407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83739f0-7fba-470f-99b7-506d283d6ca0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:11:43.885109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a83739f0-7fba-470f-99b7-506d283d6ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:11:43.897944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83739f0-7fba-470f-99b7-506d283d6ca0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:11:43.902023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744d922-83ba-4802-ad0c-550184159f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:11:43.902708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744d922-83ba-4802-ad0c-550184159f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:11:43.902990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744d922-83ba-4802-ad0c-550184159f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:11:43.903261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744d922-83ba-4802-ad0c-550184159f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:11:43.912150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744d922-83ba-4802-ad0c-550184159f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:11:43.913566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744d922-83ba-4802-ad0c-550184159f8b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:11:43.923488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 766/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:11:53.558355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=11 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:11:53.919404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:15.930270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3ae6-5782-4399-a336-3968b1859a8f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:15.931680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3ae6-5782-4399-a336-3968b1859a8f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:15.932233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3ae6-5782-4399-a336-3968b1859a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:15.956854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9a0d3ae6-5782-4399-a336-3968b1859a8f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:15.959326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9a0d3ae6-5782-4399-a336-3968b1859a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:15.974847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 774/1540] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:15.985327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc92ce-da59-4559-b1cb-0f2e97970d3e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:15.985959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc92ce-da59-4559-b1cb-0f2e97970d3e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:15.985959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc92ce-da59-4559-b1cb-0f2e97970d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.019743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f0fc92ce-da59-4559-b1cb-0f2e97970d3e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.021046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0fc92ce-da59-4559-b1cb-0f2e97970d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.035231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 767/1541] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.040490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3ae6-5782-4399-a336-3968b1859a8f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.057007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3ae6-5782-4399-a336-3968b1859a8f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.071298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5defb46-aa38-456b-9579-a3e3e77b1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.072019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defb46-aa38-456b-9579-a3e3e77b1db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.072472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defb46-aa38-456b-9579-a3e3e77b1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.072777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defb46-aa38-456b-9579-a3e3e77b1db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.073598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defb46-aa38-456b-9579-a3e3e77b1db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:16.073916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defb46-aa38-456b-9579-a3e3e77b1db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.075693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defb46-aa38-456b-9579-a3e3e77b1db1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.093096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 775/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:16.101486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc92ce-da59-4559-b1cb-0f2e97970d3e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.121590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc92ce-da59-4559-b1cb-0f2e97970d3e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.128755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.129809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.130347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.130847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.131795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.133969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.185728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b0fc-4f00-4e5c-bb53-5352eb5f694c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.186395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b0fc-4f00-4e5c-bb53-5352eb5f694c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.186920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b0fc-4f00-4e5c-bb53-5352eb5f694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.191937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 768/1543] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:16.196926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.224301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d7e4b0fc-4f00-4e5c-bb53-5352eb5f694c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.226632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7e4b0fc-4f00-4e5c-bb53-5352eb5f694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.352459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92583fe5-11b7-41e6-84d4-444548fcd7c8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.371468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.372610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.373278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.373737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.374727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 776/1544] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.375053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.376871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:13:16.376871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) Jul 21 10:13:16.376871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: Jul 21 10:13:16.380149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.384197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184fb0-6c8c-4c44-b886-7f5ec2bb6e37 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.384503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184fb0-6c8c-4c44-b886-7f5ec2bb6e37 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.384790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184fb0-6c8c-4c44-b886-7f5ec2bb6e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.418061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 769/1545] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:13:16.422482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.427273 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-73184fb0-6c8c-4c44-b886-7f5ec2bb6e37 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.428529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-73184fb0-6c8c-4c44-b886-7f5ec2bb6e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.440204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088905b-a6cc-42cf-bc4d-30689a0c3155 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.444560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 777/1546] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:13:16.446137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e7c91-9cd9-4cb3-bed9-5ff040525e34 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.446554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e7c91-9cd9-4cb3-bed9-5ff040525e34 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.446846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e7c91-9cd9-4cb3-bed9-5ff040525e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.452546 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.453249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.453534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.453809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.454898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.456545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.478614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 770/1547] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:13:16.479542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.485740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fb0e7c91-9cd9-4cb3-bed9-5ff040525e34 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.485740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fb0e7c91-9cd9-4cb3-bed9-5ff040525e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.508576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 778/1548] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.509562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e7c91-9cd9-4cb3-bed9-5ff040525e34 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.518205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afee7-4457-4bd5-a2f8-5560a55c29f2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.527086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e7c91-9cd9-4cb3-bed9-5ff040525e34 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.539536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bd9ba-fa68-4921-a7f7-51dd79ebabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.540330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd9ba-fa68-4921-a7f7-51dd79ebabf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.540623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd9ba-fa68-4921-a7f7-51dd79ebabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.540905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd9ba-fa68-4921-a7f7-51dd79ebabf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.541841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bd9ba-fa68-4921-a7f7-51dd79ebabf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.542867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.543516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bd9ba-fa68-4921-a7f7-51dd79ebabf1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.543649 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.543979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.544466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.545812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:16.546397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.548086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:13:16.548086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) Jul 21 10:13:16.548086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: Jul 21 10:13:16.554961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.565864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 779/1549] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:16.567045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8380-b238-45d2-868b-c83ebd918c11 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.567338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8380-b238-45d2-868b-c83ebd918c11 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.567623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8380-b238-45d2-868b-c83ebd918c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.590369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 771/1550] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:16.590369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.610136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e71e8380-b238-45d2-868b-c83ebd918c11 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.611437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e71e8380-b238-45d2-868b-c83ebd918c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.613006 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4fca7-ed19-4d77-918c-57da820263f7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.628388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d610051-6180-4995-983c-1c9b55c34618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.630722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d610051-6180-4995-983c-1c9b55c34618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.631007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d610051-6180-4995-983c-1c9b55c34618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.631285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d610051-6180-4995-983c-1c9b55c34618 admin admin] PATH_INFO: `/v3/projects/5626a7c1c51d439480179a9c2c5555bd/users/f1274aeb006048b790ab41824d999485/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.633657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 780/1551] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.635005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0638f3-450d-4b83-8252-7d94b351550a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.635295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0638f3-450d-4b83-8252-7d94b351550a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.636100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0638f3-450d-4b83-8252-7d94b351550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.656823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d610051-6180-4995-983c-1c9b55c34618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5626a7c1c51d439480179a9c2c5555bd, user_id=f1274aeb006048b790ab41824d999485, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.661387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d610051-6180-4995-983c-1c9b55c34618 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.664685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-db0638f3-450d-4b83-8252-7d94b351550a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.665958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-db0638f3-450d-4b83-8252-7d94b351550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.675500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 781/1552] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.676342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0638f3-450d-4b83-8252-7d94b351550a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.685315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 772/1553] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:16 2022] PUT /identity/v3/projects/5626a7c1c51d439480179a9c2c5555bd/users/f1274aeb006048b790ab41824d999485/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:16.687125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5976d-7c45-48b9-a282-4d7ac70f88c7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.687485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5976d-7c45-48b9-a282-4d7ac70f88c7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.687855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5976d-7c45-48b9-a282-4d7ac70f88c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.688663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0638f3-450d-4b83-8252-7d94b351550a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.711833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fdc5976d-7c45-48b9-a282-4d7ac70f88c7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.713396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fdc5976d-7c45-48b9-a282-4d7ac70f88c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.777665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.778393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.778705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.778946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.779645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.780662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:13:16.780662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:13:16.780662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:13:16.781850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.787915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 773/1554] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.795569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2edb3-9142-4131-a9db-52d103c90646 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.795569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2edb3-9142-4131-a9db-52d103c90646 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.795569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2edb3-9142-4131-a9db-52d103c90646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.800169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:16.811937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 782/1555] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:16.812225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-94c2edb3-9142-4131-a9db-52d103c90646 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.812493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.813547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-94c2edb3-9142-4131-a9db-52d103c90646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.851502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:16.876804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 774/1556] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.883959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345234cf-e4d2-4996-a973-bee63ce9ac89 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.883959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345234cf-e4d2-4996-a973-bee63ce9ac89 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.883959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345234cf-e4d2-4996-a973-bee63ce9ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.894704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421dae1-4a19-45fc-8f04-8b395dccdaa1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:16.899527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508cdb-ef28-4349-b225-33ec9667d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:16.900195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508cdb-ef28-4349-b225-33ec9667d5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.900472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508cdb-ef28-4349-b225-33ec9667d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.900747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508cdb-ef28-4349-b225-33ec9667d5f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.901518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508cdb-ef28-4349-b225-33ec9667d5f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:16.901770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-345234cf-e4d2-4996-a973-bee63ce9ac89 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.901891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508cdb-ef28-4349-b225-33ec9667d5f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:16.903001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-345234cf-e4d2-4996-a973-bee63ce9ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.903455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508cdb-ef28-4349-b225-33ec9667d5f1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:16.911386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 775/1557] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.912674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e995-9041-4ea2-85d6-e0680b934055 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.912956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e995-9041-4ea2-85d6-e0680b934055 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.913229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e995-9041-4ea2-85d6-e0680b934055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.923185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 783/1558] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:16.923185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f21a0-e3fe-4e2e-bb97-d699c41f7408 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.923185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f21a0-e3fe-4e2e-bb97-d699c41f7408 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.923185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f21a0-e3fe-4e2e-bb97-d699c41f7408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.932142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ae44e995-9041-4ea2-85d6-e0680b934055 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.933890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ae44e995-9041-4ea2-85d6-e0680b934055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.940810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c62f21a0-e3fe-4e2e-bb97-d699c41f7408 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.941782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 776/1559] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.942155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c62f21a0-e3fe-4e2e-bb97-d699c41f7408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.943198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9921f-5fc8-4209-8def-63abde2bc8f5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.943485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9921f-5fc8-4209-8def-63abde2bc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.943759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9921f-5fc8-4209-8def-63abde2bc8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.953298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 784/1560] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.954716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947591a-e6f8-4a49-b7dc-74e988e1b7d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.955202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947591a-e6f8-4a49-b7dc-74e988e1b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.958735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947591a-e6f8-4a49-b7dc-74e988e1b7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.967927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ebc9921f-5fc8-4209-8def-63abde2bc8f5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.969083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ebc9921f-5fc8-4209-8def-63abde2bc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.977834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7947591a-e6f8-4a49-b7dc-74e988e1b7d4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:16.979071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7947591a-e6f8-4a49-b7dc-74e988e1b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:16.981212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 777/1561] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.982162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9921f-5fc8-4209-8def-63abde2bc8f5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:16.988929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 785/1562] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:16.990411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed358f-f58a-4b0c-9706-d8016ec957f0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:16.990799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed358f-f58a-4b0c-9706-d8016ec957f0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:16.991176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed358f-f58a-4b0c-9706-d8016ec957f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:16.997622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9921f-5fc8-4209-8def-63abde2bc8f5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.003096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.003869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.004252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.004626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.005409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.008004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.010033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-94ed358f-f58a-4b0c-9706-d8016ec957f0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:17.011833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-94ed358f-f58a-4b0c-9706-d8016ec957f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:17.020291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 786/1563] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:17.021160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed358f-f58a-4b0c-9706-d8016ec957f0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.031586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed358f-f58a-4b0c-9706-d8016ec957f0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.039044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 778/1564] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:16 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.039044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.040745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.041423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.041707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.042525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.043268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:17.043577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.045199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.047804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954b14-972e-4506-8e32-4f752415f738 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.052442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556886ab-3569-4908-bcb2-95568ce7adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.053112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556886ab-3569-4908-bcb2-95568ce7adff admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.053402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556886ab-3569-4908-bcb2-95568ce7adff admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.053680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556886ab-3569-4908-bcb2-95568ce7adff admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.054408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556886ab-3569-4908-bcb2-95568ce7adff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.056324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556886ab-3569-4908-bcb2-95568ce7adff admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.058471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 787/1565] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:17.059315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.088322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 779/1566] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.089479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3b346-e694-4109-9c6c-58245a8aa719 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.089765 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3b346-e694-4109-9c6c-58245a8aa719 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.090041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3b346-e694-4109-9c6c-58245a8aa719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.108773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-61e3b346-e694-4109-9c6c-58245a8aa719 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:17.110003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-61e3b346-e694-4109-9c6c-58245a8aa719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:17.124962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c2d3e-b2a7-4e78-bb87-909f60e6fb43 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.180818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 780/1567] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:17.182643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2fbd6-2b33-4938-8b79-484cfb2007a6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.183428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2fbd6-2b33-4938-8b79-484cfb2007a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.183706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2fbd6-2b33-4938-8b79-484cfb2007a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.189826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.190700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.190988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.191325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.201361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.202859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.210376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d3a2fbd6-2b33-4938-8b79-484cfb2007a6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:17.211707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d3a2fbd6-2b33-4938-8b79-484cfb2007a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:17.213799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 788/1568] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:17.214683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.222208 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 781/1569] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:17.223059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2fbd6-2b33-4938-8b79-484cfb2007a6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.225617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b469-fb1f-4b68-85d8-e4c51149aeee service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.239612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.240281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2fbd6-2b33-4938-8b79-484cfb2007a6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.240446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.240601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.240881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.241628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:17.241942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.243675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.246994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.247807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.248196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.248661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.249745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:17.250284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.252226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.260572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 789/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:17.261451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.269775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 782/1571] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:17.270876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.279398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3e824-a43b-4290-b47a-7b5888a77104 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.284868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.285934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.286266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.287062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.287818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.289456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.294788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1a26-d2de-4e73-b82b-c38735302b98 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.301768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.302785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.303223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.303661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.304161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 790/1572] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:17.304883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.307110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.308590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.320204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac1c55-2760-47f0-a7c8-1202ee6565e8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.327146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.327946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.328230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.328500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.329233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.331200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.352444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 783/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.352444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.355652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:17.360406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 791/1574] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/users => generated 286 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.365051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.373423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d958728-32fc-484c-921e-147213c92340 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.378617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:17.442690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87da1-3d55-4038-8013-9cb8840a4ea0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.449029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.450302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.450761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.451094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.451984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.452140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:17.452361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.452799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.453156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.453546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.454036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.454409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:17.454824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.456793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.473875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 792/1575] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:17.474778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.483110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 784/1576] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:17.484566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.487102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f127d5-213c-4375-9efb-ae97fb0ae377 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.497185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67975-7e08-4d83-b692-d3c30ca54c33 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.497361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.497890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.498209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.498520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.499278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.501304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.502600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.503267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.503554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.503981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.504685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.507173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.536987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 793/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.537991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.546297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 785/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.547300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.652414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe168-588a-4058-9115-402a0e670af9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.659583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.660273 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.660555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.660830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.661811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.666261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd07d5-7581-4c63-8718-1f0a99d2caca admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.666450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.674523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.675219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.675499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.675772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.677070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.679329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.684839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 794/1579] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:17.686593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.703571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197fdb8-cf8b-4c0b-8c32-ceaf136940c9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.710950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.714877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 786/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.715015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.715015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.715198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.715292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.715292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.717379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.729965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e212-f062-4179-b1b1-a846fcf85491 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.732257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 795/1581] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:17.738241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.741846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.742590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.742929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.743196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.743843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.745468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b212-9373-485f-be98-692600c6ccc3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.745822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.751311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.752233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.753174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.753519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.754558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.756772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.783935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 787/1582] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.783935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.793293 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 796/1583] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.794066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.845105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:17.848596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:17.868239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8d707-47c2-4ef7-8b4c-d735a9f66cd0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.874658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.875227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6773-1ef3-4ef6-9592-5319582f44d9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.875543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.876056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.876465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.877500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.879287 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.880915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.881731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.882021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.882392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.883160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.885138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.909848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 788/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.911176 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.911374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 797/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:17.912310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.924850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad40c93-b3bf-4c38-9b8d-16666e36c286 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.925131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794d54-33aa-4e92-9c5f-5c8b17c7d801 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.932579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.933063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.933480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.933840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.934633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.934971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.935412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.936625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.943043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.943463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] PATH_INFO: `/v3/projects/0b5845b217704fe4866953d3d169c1be/users/cb3146ed5b1947ee99cba2e95a777a6f/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.951084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 798/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:17.951084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:17.968365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9475ea-75f2-44ed-957e-2523a1533add admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:17.973974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:17.974489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:17.974840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:17.975128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:17.975886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.977775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.984055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5845b217704fe4866953d3d169c1be, user_id=cb3146ed5b1947ee99cba2e95a777a6f, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:17.986753 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:17.990332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 799/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:17.991453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.004229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad17aef-d5eb-450d-91a9-0d21d8a17fd9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.006274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 789/1588] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:17 2022] PUT /identity/v3/projects/0b5845b217704fe4866953d3d169c1be/users/cb3146ed5b1947ee99cba2e95a777a6f/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:18.007774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.073004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.074431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.074720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.075002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.075714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.077765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.098082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82b8e-dd78-41a4-9966-8185ce82141a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.106979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 800/1589] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:17 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:18.107638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.114421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.116345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.116900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.117827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.118936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6721d1b-7587-4c30-ae13-7b03f55c226e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.120963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.125172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.126328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.127085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.127529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.127814 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.128680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.132737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.144574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 801/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.145559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.155595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 790/1591] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:18 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:18.159886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.167411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdb2c9-1716-44b3-92d7-94d1e27c33fe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.173936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.174917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10c00d-536b-497f-bcdf-0c31f8440f4c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.175267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.175773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.176208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.176968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.178760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.179842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d91492-4025-41cc-be7c-45631659cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.180746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d91492-4025-41cc-be7c-45631659cf67 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.181654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d91492-4025-41cc-be7c-45631659cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.182120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d91492-4025-41cc-be7c-45631659cf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.183423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d91492-4025-41cc-be7c-45631659cf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.185074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d91492-4025-41cc-be7c-45631659cf67 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.196460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 802/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.196460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.200830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 791/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.200830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc0a5-66f6-4e8b-bdff-ae3ff675f37d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.200830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc0a5-66f6-4e8b-bdff-ae3ff675f37d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.200830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc0a5-66f6-4e8b-bdff-ae3ff675f37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.206424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5af4-5263-423b-b388-41500d1cd24d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.212529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.213376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.214187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.214611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] PATH_INFO: `/v3/projects/4120055d5dca4c308dc440f7342899a9/users/c2e050d33316487ea43cc7a6e31abfeb/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.224433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3bfdc0a5-66f6-4e8b-bdff-ae3ff675f37d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:18.226222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3bfdc0a5-66f6-4e8b-bdff-ae3ff675f37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:18.236844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4120055d5dca4c308dc440f7342899a9, user_id=c2e050d33316487ea43cc7a6e31abfeb, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.237939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:13:18.237939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:13:18.237939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:13:18.246803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 792/1594] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:18.248157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc0a5-66f6-4e8b-bdff-ae3ff675f37d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.251217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.265011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc0a5-66f6-4e8b-bdff-ae3ff675f37d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.276245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 803/1595] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:18 2022] PUT /identity/v3/projects/4120055d5dca4c308dc440f7342899a9/users/c2e050d33316487ea43cc7a6e31abfeb/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:18.277216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.341380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.342209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.342588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.342942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.343760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.345660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.354987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:18.364600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 793/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.364600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.376160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e6f9-3e58-4322-a440-b3e18410f09f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.383064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.383836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.384123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.384325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb22b3-6e25-436c-a404-1baf4d04fc92 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.384702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.385784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.387517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.390787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.392092 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.392463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.392800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.394207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.396241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.403338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 794/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.404248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.419140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 804/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.420078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c02f6-624b-4f8b-b754-369d0e93ebdb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.420337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.425909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.426741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.427078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.428014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.428838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.430661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.432431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:18.439786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657d8ee-9935-47e9-9054-f68691d271cc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.450408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 795/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.451666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.465661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a9323-9556-449f-8396-79626109212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.466748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9323-9556-449f-8396-79626109212f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.467087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9323-9556-449f-8396-79626109212f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.468147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9323-9556-449f-8396-79626109212f admin admin] PATH_INFO: `/v3/projects/8804e6669b274c118f26e0984e409917/users/b0ff075d9612455a93a898413e8a948e/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.492809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a9323-9556-449f-8396-79626109212f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8804e6669b274c118f26e0984e409917, user_id=b0ff075d9612455a93a898413e8a948e, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.496518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a9323-9556-449f-8396-79626109212f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.521021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 805/1600] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:18 2022] PUT /identity/v3/projects/8804e6669b274c118f26e0984e409917/users/b0ff075d9612455a93a898413e8a948e/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:18.523349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9115-97a8-45f8-91a7-da2f6821e4e1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.523640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9115-97a8-45f8-91a7-da2f6821e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.524055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9115-97a8-45f8-91a7-da2f6821e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.538960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d16b2-5e7c-48ce-a566-027735d71f37 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.558975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e44c9115-97a8-45f8-91a7-da2f6821e4e1 None None] MFA Rules not processed for user `c2e050d33316487ea43cc7a6e31abfeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:18.560329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e44c9115-97a8-45f8-91a7-da2f6821e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:18.634449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.636247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.636610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.636983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.661356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 806/1601] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:18.665936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9115-97a8-45f8-91a7-da2f6821e4e1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.762919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.766314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.773103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9115-97a8-45f8-91a7-da2f6821e4e1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.782795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.785619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 796/1602] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:18.787005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.787379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.787757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.788046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.788847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.795295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.803331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2dc01-5152-464a-9954-aea81c7a633a service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.811559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.812626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.813076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.813523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.814800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.816733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 807/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.817460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.817664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.851932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351d3d-239f-4c5c-93ff-f79e0cb94dda admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.854708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 797/1604] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:18.858380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.867696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda0307-e8e0-4474-bed8-6d4cbfbc7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.868903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0307-e8e0-4474-bed8-6d4cbfbc7ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.869808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0307-e8e0-4474-bed8-6d4cbfbc7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.870259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0307-e8e0-4474-bed8-6d4cbfbc7ec9 admin admin] PATH_INFO: `/v3/projects/b06deaa684cc46ae9eadc92106ccd552/users/7c7fd1eea41f496d8660a444760af6fa/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.877110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ce4b2-b10f-4eac-8738-6c7eebfeac32 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:18.884509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fffa4-e4e6-48b7-9f9e-0e43c84fb43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:18.886643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fffa4-e4e6-48b7-9f9e-0e43c84fb43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.887063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fffa4-e4e6-48b7-9f9e-0e43c84fb43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.887475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fffa4-e4e6-48b7-9f9e-0e43c84fb43a admin admin] PATH_INFO: `/v3/projects/e4bb5615a03f42a4a19961dba0186b6d/users/c2744979411e4e1383e4212739b937dc/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.898459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda0307-e8e0-4474-bed8-6d4cbfbc7ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06deaa684cc46ae9eadc92106ccd552, user_id=7c7fd1eea41f496d8660a444760af6fa, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.901724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda0307-e8e0-4474-bed8-6d4cbfbc7ec9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.929698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 808/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:18 2022] PUT /identity/v3/projects/b06deaa684cc46ae9eadc92106ccd552/users/7c7fd1eea41f496d8660a444760af6fa/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:18.929698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2ffd-711e-4ccc-a706-3e28717a8ff0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.929698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2ffd-711e-4ccc-a706-3e28717a8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.929698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2ffd-711e-4ccc-a706-3e28717a8ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.930269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fffa4-e4e6-48b7-9f9e-0e43c84fb43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bb5615a03f42a4a19961dba0186b6d, user_id=c2744979411e4e1383e4212739b937dc, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:18.930269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fffa4-e4e6-48b7-9f9e-0e43c84fb43a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:18.945040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-949d2ffd-711e-4ccc-a706-3e28717a8ff0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:18.946867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-949d2ffd-711e-4ccc-a706-3e28717a8ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:18.958297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 798/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:18 2022] PUT /identity/v3/projects/e4bb5615a03f42a4a19961dba0186b6d/users/c2744979411e4e1383e4212739b937dc/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:18.960017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2932-023a-4ecd-b9ac-557a497ff572 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:18.960468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2932-023a-4ecd-b9ac-557a497ff572 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:18.960947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2932-023a-4ecd-b9ac-557a497ff572 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:18.962851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 799/1607] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jul 21 10:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:18.964328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2932-023a-4ecd-b9ac-557a497ff572 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:18.991383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:19.024245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:19.055162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 809/1608] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:19.056524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d2ffd-711e-4ccc-a706-3e28717a8ff0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:19.079978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2932-023a-4ecd-b9ac-557a497ff572 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:19.082897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d2ffd-711e-4ccc-a706-3e28717a8ff0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:19.088044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9a5a-0786-4d53-9bf3-94defc8fd9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:19.089117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a5a-0786-4d53-9bf3-94defc8fd9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.089392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a5a-0786-4d53-9bf3-94defc8fd9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.089665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a5a-0786-4d53-9bf3-94defc8fd9c6 admin admin] PATH_INFO: `/v3/projects/99fae28c6cac48538c2b41eb10ed4dfd/users/1910c2ca26d8469189a4282ce176dbb0/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.090280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655bbee-1019-4bb0-a590-00cc4faa3118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:19.092184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655bbee-1019-4bb0-a590-00cc4faa3118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.092506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655bbee-1019-4bb0-a590-00cc4faa3118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.095589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655bbee-1019-4bb0-a590-00cc4faa3118 admin admin] PATH_INFO: `/v3/projects/03452ef988ef4428bdcaa554b7bd4700/users/b3e73f3002da4da3b94cb17f837defb8/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.109404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9a5a-0786-4d53-9bf3-94defc8fd9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fae28c6cac48538c2b41eb10ed4dfd, user_id=1910c2ca26d8469189a4282ce176dbb0, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:19.112042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9a5a-0786-4d53-9bf3-94defc8fd9c6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:19.119151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655bbee-1019-4bb0-a590-00cc4faa3118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03452ef988ef4428bdcaa554b7bd4700, user_id=b3e73f3002da4da3b94cb17f837defb8, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:19.122979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655bbee-1019-4bb0-a590-00cc4faa3118 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:19.133429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 810/1609] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:19 2022] PUT /identity/v3/projects/99fae28c6cac48538c2b41eb10ed4dfd/users/1910c2ca26d8469189a4282ce176dbb0/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:19.135020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2781e85-e78b-474d-8163-a5d12de7da60 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.135331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2781e85-e78b-474d-8163-a5d12de7da60 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.135898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2781e85-e78b-474d-8163-a5d12de7da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.146257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 800/1610] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:18 2022] PUT /identity/v3/projects/03452ef988ef4428bdcaa554b7bd4700/users/b3e73f3002da4da3b94cb17f837defb8/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:19.150737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6fa4f-a6e3-42bf-b3b6-fcd64b5e26d6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.151299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6fa4f-a6e3-42bf-b3b6-fcd64b5e26d6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.151818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6fa4f-a6e3-42bf-b3b6-fcd64b5e26d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.257581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e7e6fa4f-a6e3-42bf-b3b6-fcd64b5e26d6 None None] MFA Rules not processed for user `c2744979411e4e1383e4212739b937dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:19.257581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e7e6fa4f-a6e3-42bf-b3b6-fcd64b5e26d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:19.262776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f2781e85-e78b-474d-8163-a5d12de7da60 None None] MFA Rules not processed for user `7c7fd1eea41f496d8660a444760af6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:19.262776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f2781e85-e78b-474d-8163-a5d12de7da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:19.360018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 801/1611] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:19.364855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ea2a-6f28-4001-89aa-043b902bb796 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.365193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ea2a-6f28-4001-89aa-043b902bb796 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.365425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ea2a-6f28-4001-89aa-043b902bb796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.407152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 811/1612] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:19.407984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2781e85-e78b-474d-8163-a5d12de7da60 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:19.477177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fa79ea2a-6f28-4001-89aa-043b902bb796 None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:19.478491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fa79ea2a-6f28-4001-89aa-043b902bb796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:19.516343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2781e85-e78b-474d-8163-a5d12de7da60 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:19.524492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:19.525151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.525441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.525722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.595003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 802/1613] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jul 21 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:19.597084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe36078-85ec-48be-a6dd-16be2ed4f8b3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.597476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe36078-85ec-48be-a6dd-16be2ed4f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.597855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe36078-85ec-48be-a6dd-16be2ed4f8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.603007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:19.630185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cbe36078-85ec-48be-a6dd-16be2ed4f8b3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:19.630436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:19.632090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cbe36078-85ec-48be-a6dd-16be2ed4f8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:19.632677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:19.643414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 803/1614] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:19.645127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1c83e-41d7-48f2-9c28-ca5fc66a8d5f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.645529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1c83e-41d7-48f2-9c28-ca5fc66a8d5f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.645898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1c83e-41d7-48f2-9c28-ca5fc66a8d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.646552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 812/1615] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:19.647416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:19.662025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae223ea2-acb7-449d-b4c3-b22f476275ea service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:19.668899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:19.670486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:19.672719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.673644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.674945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.676171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:19.680305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:19.682663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-72d1c83e-41d7-48f2-9c28-ca5fc66a8d5f None None] MFA Rules not processed for user `1910c2ca26d8469189a4282ce176dbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:19.683986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-72d1c83e-41d7-48f2-9c28-ca5fc66a8d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:19.767166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 813/1616] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:19 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:19.773580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:19.823510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 804/1617] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:19.829416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1c83e-41d7-48f2-9c28-ca5fc66a8d5f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:19.865155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1c83e-41d7-48f2-9c28-ca5fc66a8d5f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:19.916424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda164a-4da0-4a87-8410-3bfe0a01cd3f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:19.928883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:19.929957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:19.931600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:19.931900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:19.934109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:19.937955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.005674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.006907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.007259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.007611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.022541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 814/1618] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:19 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:20.023727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.031283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:20.130478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be516-3deb-4079-97ae-f60ff892c3b3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.135036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8b4c-98ee-4997-8818-ee591306e2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.136644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8b4c-98ee-4997-8818-ee591306e2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.137237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8b4c-98ee-4997-8818-ee591306e2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.137533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8b4c-98ee-4997-8818-ee591306e2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.147498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.153932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.190857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 805/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:20.191977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.215625 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c73c4-7a9c-476f-ba04-8f3ee5e910c3 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.252418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:20.268093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:20.269781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8b4c-98ee-4997-8818-ee591306e2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.271437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8b4c-98ee-4997-8818-ee591306e2f7 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.300315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 815/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:20.303128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdae3-4b8c-41dd-9527-0c1e9e7480f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.304168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdae3-4b8c-41dd-9527-0c1e9e7480f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.304692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdae3-4b8c-41dd-9527-0c1e9e7480f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.305341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdae3-4b8c-41dd-9527-0c1e9e7480f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.305536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe395-bb95-452b-9c70-ef77e0ac02a9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.306286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdae3-4b8c-41dd-9527-0c1e9e7480f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.306557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe395-bb95-452b-9c70-ef77e0ac02a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.307712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe395-bb95-452b-9c70-ef77e0ac02a9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.309119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdae3-4b8c-41dd-9527-0c1e9e7480f2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.313732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 816/1621] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jul 21 10:13:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:20.314894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe395-bb95-452b-9c70-ef77e0ac02a9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.359637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe395-bb95-452b-9c70-ef77e0ac02a9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.371839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 806/1622] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:20 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:20.372970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.373754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.374046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.374406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.374860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774a68d-13d8-4ad4-91f5-1c86007835fa None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.375118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.375512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774a68d-13d8-4ad4-91f5-1c86007835fa None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.376246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774a68d-13d8-4ad4-91f5-1c86007835fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.382087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.418835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f774a68d-13d8-4ad4-91f5-1c86007835fa None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:20.424104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f774a68d-13d8-4ad4-91f5-1c86007835fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:20.440022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 817/1623] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:20 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:20.442201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.458951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8f1a9-8b0c-44bb-b2c1-2d79b32938b2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.467105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.472297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.474352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.474930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.479516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.483639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.509715 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 818/1624] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:20.513163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.533075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139654b6-4bdc-4670-aeaf-d50faa599c3a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.538898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.539895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.540577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.541116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.542673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.546991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.595305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 819/1625] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:20.596719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.624582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27107f-0033-4717-b9e9-7d9f17951055 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.643319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 807/1626] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jul 21 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:20.644990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774a68d-13d8-4ad4-91f5-1c86007835fa None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.648659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.652649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.653094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.655141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] PATH_INFO: `/v3/projects/913100ee5fa24703aa6619bf1fa8909d/users/c7bbe4e293eb49e58d364f921153a58c/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.676927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774a68d-13d8-4ad4-91f5-1c86007835fa None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.690492 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.692632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.692922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.693237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] PATH_INFO: `/v3/projects/c5959d61a2ff4b7ca8024fb0d3fe8843/users/f790674ac783485b8bbec3fb799cb0d6/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.695796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=913100ee5fa24703aa6619bf1fa8909d, user_id=c7bbe4e293eb49e58d364f921153a58c, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.702816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.733451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 820/1627] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:20 2022] PUT /identity/v3/projects/913100ee5fa24703aa6619bf1fa8909d/users/c7bbe4e293eb49e58d364f921153a58c/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:20.735177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.737647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5959d61a2ff4b7ca8024fb0d3fe8843, user_id=f790674ac783485b8bbec3fb799cb0d6, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.745894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:20.775334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 808/1628] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:20 2022] PUT /identity/v3/projects/c5959d61a2ff4b7ca8024fb0d3fe8843/users/f790674ac783485b8bbec3fb799cb0d6/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:20.778651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:20.911095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12594adb-3bc3-42a9-b1d8-65c7167963b2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.957695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8fdb-960e-4043-998d-5d6c711f6ca8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:20.968550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:20.969674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:20.970421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:20.970927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:20.972493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:20.975538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:21.012446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 809/1629] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:21.015434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:21.036285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d24cf-f19a-4f96-a678-787097ec261c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:21.048293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0bba9-a158-45e6-831d-c9218f642c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:21.050465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0bba9-a158-45e6-831d-c9218f642c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.051251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0bba9-a158-45e6-831d-c9218f642c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.053621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0bba9-a158-45e6-831d-c9218f642c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.055633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0bba9-a158-45e6-831d-c9218f642c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:21.061909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0bba9-a158-45e6-831d-c9218f642c9e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:21.089394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69896-7823-4179-a5fd-36f5f0f94ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:21.090280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69896-7823-4179-a5fd-36f5f0f94ad0 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.090672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69896-7823-4179-a5fd-36f5f0f94ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.091798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69896-7823-4179-a5fd-36f5f0f94ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.105220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 810/1630] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:21.109644 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900446-dd9e-4a57-88d0-c82256d352dc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.109953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900446-dd9e-4a57-88d0-c82256d352dc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.110226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900446-dd9e-4a57-88d0-c82256d352dc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.119003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 811/1631] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jul 21 10:13:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:21.121343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900446-dd9e-4a57-88d0-c82256d352dc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:21.168771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900446-dd9e-4a57-88d0-c82256d352dc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:21.184335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:21.188679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:21.192027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.193165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.193559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] PATH_INFO: `/v3/projects/913100ee5fa24703aa6619bf1fa8909d/users/c7bbe4e293eb49e58d364f921153a58c/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.201446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=913100ee5fa24703aa6619bf1fa8909d, user_id=c7bbe4e293eb49e58d364f921153a58c, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:21.211405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:21.247106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 812/1632] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:21 2022] PUT /identity/v3/projects/913100ee5fa24703aa6619bf1fa8909d/users/c7bbe4e293eb49e58d364f921153a58c/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:21.248000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:21.279003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:21.281310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea69896-7823-4179-a5fd-36f5f0f94ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:21.286333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea69896-7823-4179-a5fd-36f5f0f94ad0 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:21.310641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 821/1633] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:21.312288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d95db-6ab3-44b9-acc0-86b3a2497069 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.312580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d95db-6ab3-44b9-acc0-86b3a2497069 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.312865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d95db-6ab3-44b9-acc0-86b3a2497069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.352762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-749d95db-6ab3-44b9-acc0-86b3a2497069 None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:21.354843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-749d95db-6ab3-44b9-acc0-86b3a2497069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:21.395576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d235-17a1-4274-a397-4ad77c6c5c30 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:21.408454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a722c95-eca3-4a50-9951-79f0141b3c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:21.409379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722c95-eca3-4a50-9951-79f0141b3c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.409661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722c95-eca3-4a50-9951-79f0141b3c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.409934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722c95-eca3-4a50-9951-79f0141b3c14 admin admin] PATH_INFO: `/v3/projects/c5959d61a2ff4b7ca8024fb0d3fe8843/users/f790674ac783485b8bbec3fb799cb0d6/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.415284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a722c95-eca3-4a50-9951-79f0141b3c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5959d61a2ff4b7ca8024fb0d3fe8843, user_id=f790674ac783485b8bbec3fb799cb0d6, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:21.419054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a722c95-eca3-4a50-9951-79f0141b3c14 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:21.442372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 813/1634] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:21 2022] PUT /identity/v3/projects/c5959d61a2ff4b7ca8024fb0d3fe8843/users/f790674ac783485b8bbec3fb799cb0d6/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:21.443486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ef48-c764-4d92-9383-d1f54699e33c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.443779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ef48-c764-4d92-9383-d1f54699e33c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.444417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ef48-c764-4d92-9383-d1f54699e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.514041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a0f7ef48-c764-4d92-9383-d1f54699e33c None None] MFA Rules not processed for user `c7bbe4e293eb49e58d364f921153a58c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:21.517937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a0f7ef48-c764-4d92-9383-d1f54699e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:21.532264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 822/1635] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:21.533875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af893-64b4-4b29-afb3-61fcbc08f3c9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.534119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af893-64b4-4b29-afb3-61fcbc08f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.535318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af893-64b4-4b29-afb3-61fcbc08f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.591261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b50af893-64b4-4b29-afb3-61fcbc08f3c9 None None] MFA Rules not processed for user `f790674ac783485b8bbec3fb799cb0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:21.592345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b50af893-64b4-4b29-afb3-61fcbc08f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:21.686253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 814/1636] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:21.687214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7ef48-c764-4d92-9383-d1f54699e33c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:21.751806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 823/1637] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:21.752995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50af893-64b4-4b29-afb3-61fcbc08f3c9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:21.811180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7ef48-c764-4d92-9383-d1f54699e33c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:21.820384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:21.821118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.821405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.821680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.853344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:21.881337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50af893-64b4-4b29-afb3-61fcbc08f3c9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:21.889119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb30013-c9cf-4d73-9bf4-58297f37a65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:21.889796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30013-c9cf-4d73-9bf4-58297f37a65a service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:21.890082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30013-c9cf-4d73-9bf4-58297f37a65a service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:21.890390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30013-c9cf-4d73-9bf4-58297f37a65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:21.912305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb30013-c9cf-4d73-9bf4-58297f37a65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:21.913759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb30013-c9cf-4d73-9bf4-58297f37a65a service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:21.916405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:21.944380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 824/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:21.985049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:21.986669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:22.008612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4d32-39ba-4268-8dbc-64c5bfbc5e22 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:22.008922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4d32-39ba-4268-8dbc-64c5bfbc5e22 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:22.009177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4d32-39ba-4268-8dbc-64c5bfbc5e22 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:22.011507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 825/1639] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jul 21 10:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:22.024232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 815/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:22.036850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ca356-1a1e-461f-9a4c-d285f7e410db None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:22.038291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ca356-1a1e-461f-9a4c-d285f7e410db None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:22.039642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ca356-1a1e-461f-9a4c-d285f7e410db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:22.057150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:22.071585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fa3e-a96f-4f48-98b4-9175c0364b9f service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:22.082512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:22.082512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:22.082512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:22.082512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:22.083203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1d4ca356-1a1e-461f-9a4c-d285f7e410db None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:22.085755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1d4ca356-1a1e-461f-9a4c-d285f7e410db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:22.097300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:22.100292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:22.109803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 826/1641] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:13:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:22.148169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 816/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:13:22.357189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ca356-1a1e-461f-9a4c-d285f7e410db None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:22.367644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ca356-1a1e-461f-9a4c-d285f7e410db None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:22.379322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:22.380072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:22.380362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:22.381047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:22.411252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:22.417129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:22.459226 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 827/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:22.652245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:22.663099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdec47-d0eb-4394-9138-321d51c82e7d service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:22.669540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c902-7911-4df8-92d6-0c6206028c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:22.670310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c902-7911-4df8-92d6-0c6206028c38 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:22.670597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c902-7911-4df8-92d6-0c6206028c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:22.670877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c902-7911-4df8-92d6-0c6206028c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:22.810782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c902-7911-4df8-92d6-0c6206028c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:22.814452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c902-7911-4df8-92d6-0c6206028c38 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:22.851486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 817/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:23.206308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:23.348965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff785e-f69c-4ef0-8a86-6f3348cec282 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:23.364331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:23.365813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:23.366333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:23.366816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] PATH_INFO: `/v3/users/1910c2ca26d8469189a4282ce176dbb0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:23.369167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1910c2ca26d8469189a4282ce176dbb0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:23.371384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:13:23.371384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Jul 21 10:13:23.371384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: Jul 21 10:13:23.373017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:23.484225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1910c2ca26d8469189a4282ce176dbb0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:23.519279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1910c2ca26d8469189a4282ce176dbb0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:23.539289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1910c2ca26d8469189a4282ce176dbb0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:23.550844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1910c2ca26d8469189a4282ce176dbb0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:23.552140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1910c2ca26d8469189a4282ce176dbb0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:23.599326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 828/1645] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:23 2022] DELETE /identity/v3/users/1910c2ca26d8469189a4282ce176dbb0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:23.606077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:23.606396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:23.606682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:23.637678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:23.640073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:23.809733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:23.812195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:23.842561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fec01-a78b-459c-9fed-f3a272f29d35 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:23.845362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 818/1646] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:23.859347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:23.862240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:23.863304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:23.864388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:23.873361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:23.874908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] PATH_INFO: `/v3/users/7c7fd1eea41f496d8660a444760af6fa` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:23.882613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7fd1eea41f496d8660a444760af6fa)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:23.887767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:23.993741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:24.006862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7fd1eea41f496d8660a444760af6fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:24.019165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2f066-ccd6-4be9-8324-19bb4be4c80b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:24.028572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2700be-b09e-44e0-a500-9dee9220c7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:24.029439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2700be-b09e-44e0-a500-9dee9220c7ed service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:24.029881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2700be-b09e-44e0-a500-9dee9220c7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:24.030213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2700be-b09e-44e0-a500-9dee9220c7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:24.040097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7fd1eea41f496d8660a444760af6fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:24.049668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:24.054917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2700be-b09e-44e0-a500-9dee9220c7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:24.059352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7fd1eea41f496d8660a444760af6fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:24.060735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2700be-b09e-44e0-a500-9dee9220c7ed service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:24.075470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7fd1eea41f496d8660a444760af6fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:24.076175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7fd1eea41f496d8660a444760af6fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:24.081935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 819/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:13:24.090350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 829/1648] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:23 2022] DELETE /identity/v3/users/7c7fd1eea41f496d8660a444760af6fa => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:24.095480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:24.095813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:24.096123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:24.132592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:24.134596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:24.279703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 820/1649] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:24.554604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:24.556401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:24.735754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c929c-7b73-4880-a0c4-4bd483f0d582 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:24.740270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:24.740976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:24.742112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:24.742437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:24.779542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:24.781346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:24.809177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 830/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:25.911250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:25.913061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:25.936550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77c8b-ecc8-457b-8a8d-11c8e4678c53 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:25.990790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:25.993440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:25.993567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:25.993844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] PATH_INFO: `/v3/projects/99fae28c6cac48538c2b41eb10ed4dfd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:26.000269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fae28c6cac48538c2b41eb10ed4dfd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:26.005181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:13:26.005181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) Jul 21 10:13:26.005181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: Jul 21 10:13:26.010954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:26.212955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fae28c6cac48538c2b41eb10ed4dfd', 'request_id': 'req-eabbe93c-72e3-467d-8490-a762e5535c5c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.230783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:26.233514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:26.237598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fae28c6cac48538c2b41eb10ed4dfd', 'request_id': 'req-eabbe93c-72e3-467d-8490-a762e5535c5c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.261490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fae28c6cac48538c2b41eb10ed4dfd', 'request_id': 'req-eabbe93c-72e3-467d-8490-a762e5535c5c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.290503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d19f-9fa1-428a-8b55-8e61a83ef984 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:26.304266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] The token cache is being invalidate because project 99fae28c6cac48538c2b41eb10ed4dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:26.305383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.309437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-eabbe93c-72e3-467d-8490-a762e5535c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.326443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 821/1651] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:25 2022] DELETE /identity/v3/projects/99fae28c6cac48538c2b41eb10ed4dfd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:26.348339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ea23-355a-482b-8a30-2d99c479bcfc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:26.348891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ea23-355a-482b-8a30-2d99c479bcfc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:26.349324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ea23-355a-482b-8a30-2d99c479bcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:26.415685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-28e9ea23-355a-482b-8a30-2d99c479bcfc None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:26.417671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-28e9ea23-355a-482b-8a30-2d99c479bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:26.618768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 822/1652] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:26.634240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82fdb5-69e9-45b2-8dc5-c89ba1942e73 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:26.634689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82fdb5-69e9-45b2-8dc5-c89ba1942e73 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:26.635098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82fdb5-69e9-45b2-8dc5-c89ba1942e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:26.686973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:26.688199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:26.688199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:26.688413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] PATH_INFO: `/v3/projects/b06deaa684cc46ae9eadc92106ccd552` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:26.689697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06deaa684cc46ae9eadc92106ccd552)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:26.691681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:26.696535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-eb82fdb5-69e9-45b2-8dc5-c89ba1942e73 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:26.701110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eb82fdb5-69e9-45b2-8dc5-c89ba1942e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:26.730367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 823/1653] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:26.736745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82fdb5-69e9-45b2-8dc5-c89ba1942e73 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:26.768244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82fdb5-69e9-45b2-8dc5-c89ba1942e73 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:26.791246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:26.795322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06deaa684cc46ae9eadc92106ccd552', 'request_id': 'req-0c2b7387-6a6f-458a-b04c-fd73aaba0297'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.808471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06deaa684cc46ae9eadc92106ccd552', 'request_id': 'req-0c2b7387-6a6f-458a-b04c-fd73aaba0297'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.824764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06deaa684cc46ae9eadc92106ccd552', 'request_id': 'req-0c2b7387-6a6f-458a-b04c-fd73aaba0297'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.826783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:26.863644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] The token cache is being invalidate because project b06deaa684cc46ae9eadc92106ccd552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:26.863644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.864325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:26.868963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 831/1654] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:26 2022] DELETE /identity/v3/projects/b06deaa684cc46ae9eadc92106ccd552 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:26.871446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:26.875789 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:26.941098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:26.941801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:26.942081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:26.942380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:26.943132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:26.943424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:26.945054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:26.975958 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 824/1655] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:13:26.982975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:26.985047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:27.006294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ef8e1-fa71-45dd-9435-4ef8e72aba7d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:27.017968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:27.021018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.022242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.022476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.023144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:27.030357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:27.043634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b7387-6a6f-458a-b04c-fd73aaba0297 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:27.062780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:27.063916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.064445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.065050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] PATH_INFO: `/v3/users/f790674ac783485b8bbec3fb799cb0d6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.066907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f790674ac783485b8bbec3fb799cb0d6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:27.071897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:27.101386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 825/1656] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:26 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:13:27.107964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:27.166129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f790674ac783485b8bbec3fb799cb0d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.196265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f790674ac783485b8bbec3fb799cb0d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.212580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f790674ac783485b8bbec3fb799cb0d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.230129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f790674ac783485b8bbec3fb799cb0d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.231390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f790674ac783485b8bbec3fb799cb0d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.245602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 832/1657] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:26 2022] DELETE /identity/v3/users/f790674ac783485b8bbec3fb799cb0d6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:27.262946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdff89-25a4-4c7d-bc5f-72c95e900af0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:27.394404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:27.395669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.395978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.396260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.397582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:27.400210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:27.441994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 826/1658] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:27 2022] POST /identity/v3/users => generated 284 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:13:27.446260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:27.450337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:27.473939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220479-82ea-4e9e-a9f0-17c0d9fc2c50 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:27.496167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:27.497378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.497378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.497713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.498607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:27.500618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:27.527188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 833/1659] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:27.529266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:27.548906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3ff9-b396-4446-a121-aa8218dc93eb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:27.570834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:27.571539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.571832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.573624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.574458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:27.576145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:27.616419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 827/1660] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:27.617631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:27.624126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:27.625942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:27.633255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f6bff-dad4-409b-95ed-7ef10626153d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:27.645902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110e4b4-45ff-4b14-bd05-18c497eaa9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:27.647082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e4b4-45ff-4b14-bd05-18c497eaa9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.647366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e4b4-45ff-4b14-bd05-18c497eaa9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.647653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e4b4-45ff-4b14-bd05-18c497eaa9e0 admin admin] PATH_INFO: `/v3/projects/a14fc570d3b44b0bafa27d95f2cc44c6/users/2ac1b102a0c44b578da86750d80c157c/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.650086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9aec1-53dc-4c46-862a-3350516c0d90 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:27.670599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:27.671537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.671823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.672104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] PATH_INFO: `/v3/users/c2e050d33316487ea43cc7a6e31abfeb` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.677380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e050d33316487ea43cc7a6e31abfeb)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:27.681188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:27.688245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110e4b4-45ff-4b14-bd05-18c497eaa9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14fc570d3b44b0bafa27d95f2cc44c6, user_id=2ac1b102a0c44b578da86750d80c157c, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:27.691305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110e4b4-45ff-4b14-bd05-18c497eaa9e0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:27.696640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:27.733581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 834/1661] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:27 2022] PUT /identity/v3/projects/a14fc570d3b44b0bafa27d95f2cc44c6/users/2ac1b102a0c44b578da86750d80c157c/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:27.735553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.736585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.736998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.795570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e050d33316487ea43cc7a6e31abfeb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.796663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e050d33316487ea43cc7a6e31abfeb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.804179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] MFA Rules not processed for user `2ac1b102a0c44b578da86750d80c157c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:27.808717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:27.816274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e050d33316487ea43cc7a6e31abfeb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.817654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e050d33316487ea43cc7a6e31abfeb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.836720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73033ad4-e40a-4203-b8ed-14387a7e1b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e050d33316487ea43cc7a6e31abfeb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:27.867944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 828/1662] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:27 2022] DELETE /identity/v3/users/c2e050d33316487ea43cc7a6e31abfeb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:13:27.873997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:27.874822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:27.875353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:27.884822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:27.926797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:27.928583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:28.009786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 835/1663] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:28.011767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.015018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:28.042160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 829/1664] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:13:28.147589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.149014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:28.223095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c7fd-084b-4a14-b078-a4a03b653264 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:28.234866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:28.235585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:28.235842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:28.236154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:28.236846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:28.238851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:28.299344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb2f8f-8ba8-41cb-b449-5e754bed3c59 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:28.321231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 836/1665] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:28 2022] POST /identity/v3/projects => generated 367 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:28.322274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.327403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:28.329524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:28.329524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:28.332844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:28.380710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:28.382331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:28.422656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 830/1666] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:28.464154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acbf30-e381-4476-87d7-082ff3b626ed admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:28.470208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:28.470554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:28.471200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:28.471737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:28.472710 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:28.475463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:28.512148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 837/1667] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:28 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:28.513496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.524999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48989c4-cee0-4351-af7c-f292f7803ebb service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:28.536873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:28.539314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:28.539592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:28.539948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:28.542373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:28.546621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:28.567592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 831/1668] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:13:28.569054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.580459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044fff-fde9-4542-b4ca-d614a5c5b45f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:28.589669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:28.590635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:28.590923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:28.593394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] PATH_INFO: `/v3/projects/36f28103b12f4317a44c6e8e61c798e2/users/c77894b3e5204f739c560be73d8996a0/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:28.637229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f28103b12f4317a44c6e8e61c798e2, user_id=c77894b3e5204f739c560be73d8996a0, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:28.640697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:28.676719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 838/1669] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:28 2022] PUT /identity/v3/projects/36f28103b12f4317a44c6e8e61c798e2/users/c77894b3e5204f739c560be73d8996a0/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:28.679597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.711563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ee45-0ca1-4f34-a6b1-939ebb0a14b7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:28.741476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:28.779034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.781144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:28.827176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:28.852681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:28.858706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:28.860329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:28.860713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:28.863175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:28.867161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:28.898960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 832/1670] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:28.909469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:28.939766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e1c70-fdd0-46cc-ab94-cd374cee1614 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:28.971079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3ed60-240e-45a4-86d2-8a9d5dd893d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:28.972010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ed60-240e-45a4-86d2-8a9d5dd893d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:28.972301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ed60-240e-45a4-86d2-8a9d5dd893d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:28.973050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ed60-240e-45a4-86d2-8a9d5dd893d1 admin admin] PATH_INFO: `/v3/projects/36f28103b12f4317a44c6e8e61c798e2/users/c77894b3e5204f739c560be73d8996a0/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:28.974764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3ed60-240e-45a4-86d2-8a9d5dd893d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f28103b12f4317a44c6e8e61c798e2, user_id=c77894b3e5204f739c560be73d8996a0, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:28.977712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3ed60-240e-45a4-86d2-8a9d5dd893d1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:28.982226 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ae12-36fa-4ecd-b283-fc5c91883add admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:29.002309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:29.005690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.005820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 833/1671] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:28 2022] PUT /identity/v3/projects/36f28103b12f4317a44c6e8e61c798e2/users/c77894b3e5204f739c560be73d8996a0/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:29.016758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.017845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] PATH_INFO: `/v3/projects/c5959d61a2ff4b7ca8024fb0d3fe8843` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.020972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.021135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.021417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.022334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5959d61a2ff4b7ca8024fb0d3fe8843)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:29.028107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:29.069969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] MFA Rules not processed for user `c77894b3e5204f739c560be73d8996a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:29.071245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:29.142624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5959d61a2ff4b7ca8024fb0d3fe8843', 'request_id': 'req-6fb5ead4-71b1-4a9e-8623-e22605790fa0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:29.157251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5959d61a2ff4b7ca8024fb0d3fe8843', 'request_id': 'req-6fb5ead4-71b1-4a9e-8623-e22605790fa0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:29.174257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5959d61a2ff4b7ca8024fb0d3fe8843', 'request_id': 'req-6fb5ead4-71b1-4a9e-8623-e22605790fa0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:29.198380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] The token cache is being invalidate because project c5959d61a2ff4b7ca8024fb0d3fe8843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:29.198589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:29.199279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fb5ead4-71b1-4a9e-8623-e22605790fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:29.201684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 839/1672] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:28 2022] DELETE /identity/v3/projects/c5959d61a2ff4b7ca8024fb0d3fe8843 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:29.207304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03d2c-269e-4dea-bbf9-6a2f1191de6e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.207593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03d2c-269e-4dea-bbf9-6a2f1191de6e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.207868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03d2c-269e-4dea-bbf9-6a2f1191de6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.243241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 834/1673] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:13:29.255123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:29.259118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:29.264193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7ff03d2c-269e-4dea-bbf9-6a2f1191de6e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:29.265467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7ff03d2c-269e-4dea-bbf9-6a2f1191de6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:29.407111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b2562-24e3-4495-b0e5-1789c90acb4c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:29.449416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 840/1674] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:29.452346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4abd-2b2b-49d5-a103-7be0b4855c39 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.452346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4abd-2b2b-49d5-a103-7be0b4855c39 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.452346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4abd-2b2b-49d5-a103-7be0b4855c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.477216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-452d4abd-2b2b-49d5-a103-7be0b4855c39 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:29.481345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-452d4abd-2b2b-49d5-a103-7be0b4855c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:29.505918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 841/1675] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:29.517164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4abd-2b2b-49d5-a103-7be0b4855c39 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:29.525336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:29.560100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4abd-2b2b-49d5-a103-7be0b4855c39 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:29.562957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:29.565736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.566045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.566356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.571488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:29.572784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.573278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.573775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.574603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:29.574992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:29.577018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:29.600504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 842/1676] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:29.605569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:29.637359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411023c1-36cc-4294-8802-5645a7b27d99 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:29.645794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:29.647447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.647919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.648453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.649797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:29.653971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:29.699371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 843/1677] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:29 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:29.704538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:29.715145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:29.717267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:29.718313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:29.742368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 835/1678] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:29.857082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42134ed-2d5c-457f-b5cb-9a5a0e1d5e29 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:29.863082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:29.865084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.866412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.866989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.868258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:29.871609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:29.927543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:29.939182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 844/1679] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:29 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:29.948376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cc268-6c83-42e7-9a52-89a4821e72ce service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:29.962626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:29.965318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:29.974893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:29.976706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:29.977281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:29.980655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:30.001099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 836/1680] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:30.002036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:30.015788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269793b-3b3f-466f-b342-a137810a1f4d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:30.029197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7486a1-b448-4cd3-9d22-663a17fa0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:30.029197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7486a1-b448-4cd3-9d22-663a17fa0e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:30.029197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7486a1-b448-4cd3-9d22-663a17fa0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:30.029197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7486a1-b448-4cd3-9d22-663a17fa0e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:30.029641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7486a1-b448-4cd3-9d22-663a17fa0e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:30.029641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7486a1-b448-4cd3-9d22-663a17fa0e71 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:30.053128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:30.064985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 845/1681] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:30.070947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de3ca-ba54-4917-9ee4-cfc77c2c04e5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:30.088682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:30.090033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:30.090508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:30.090986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] PATH_INFO: `/v3/projects/8b94474628aa4246b5dbb71a9f3a3ff9/users/16432ec198f24951a63894bfb67b012d/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:30.154158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b94474628aa4246b5dbb71a9f3a3ff9, user_id=16432ec198f24951a63894bfb67b012d, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:30.164631 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:30.215372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 837/1682] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:30 2022] PUT /identity/v3/projects/8b94474628aa4246b5dbb71a9f3a3ff9/users/16432ec198f24951a63894bfb67b012d/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:30.225964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9ea1d-987b-4897-87f0-9201a26d454d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:30.226512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9ea1d-987b-4897-87f0-9201a26d454d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:30.226806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9ea1d-987b-4897-87f0-9201a26d454d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:30.263227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:30.265012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:30.295196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-96c9ea1d-987b-4897-87f0-9201a26d454d None None] MFA Rules not processed for user `16432ec198f24951a63894bfb67b012d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:30.296470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-96c9ea1d-987b-4897-87f0-9201a26d454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:30.449154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e467775-d793-42ad-a498-25e27a8c1a06 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:30.455938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:30.457139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:30.457424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:30.457706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] PATH_INFO: `/v3/projects/4120055d5dca4c308dc440f7342899a9` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:30.459870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4120055d5dca4c308dc440f7342899a9)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:30.462439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:30.533402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 846/1683] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:30.534825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9ea1d-987b-4897-87f0-9201a26d454d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:30.562821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9ea1d-987b-4897-87f0-9201a26d454d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:30.577550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:30.578850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:30.581962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:30.582410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:30.584384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:30.586455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:30.624341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4120055d5dca4c308dc440f7342899a9', 'request_id': 'req-4fb329fe-4ad7-41d5-a9a6-2a8400618780'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:30.659567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4120055d5dca4c308dc440f7342899a9', 'request_id': 'req-4fb329fe-4ad7-41d5-a9a6-2a8400618780'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:30.661989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:30.662779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 847/1684] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:30 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:13:30.667279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:30.703229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4120055d5dca4c308dc440f7342899a9', 'request_id': 'req-4fb329fe-4ad7-41d5-a9a6-2a8400618780'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:30.751528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] The token cache is being invalidate because project 4120055d5dca4c308dc440f7342899a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:30.751818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:30.764275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4fb329fe-4ad7-41d5-a9a6-2a8400618780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:30.766352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 838/1685] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:30 2022] DELETE /identity/v3/projects/4120055d5dca4c308dc440f7342899a9 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:30.771495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7679-cfb4-4605-9276-93b422eabbaa None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:30.771876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7679-cfb4-4605-9276-93b422eabbaa None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:30.772111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7679-cfb4-4605-9276-93b422eabbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:30.811117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7f2a7679-cfb4-4605-9276-93b422eabbaa None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:30.812446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7f2a7679-cfb4-4605-9276-93b422eabbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:30.892063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:30.911914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15fe01-a829-46ac-8220-45c3b79c6442 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:30.917432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:30.930622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:30.931054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:30.931351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:30.932668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:30.934731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:30.981948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 848/1686] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:30 2022] POST /identity/v3/users => generated 303 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:30.987157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:30.992452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:31.064734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712618b-48a6-4985-8581-735108ab74e7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.089191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:31.090247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.090683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.091108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.092033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:31.093864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:31.094416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 839/1687] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:13:31.102996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d040a-e3ef-41b5-a01b-308767b52020 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.103191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d040a-e3ef-41b5-a01b-308767b52020 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.103400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d040a-e3ef-41b5-a01b-308767b52020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.147611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 849/1688] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:31.152905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.169255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c35ed-8aff-49c5-9189-1b28006d5f5a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.179485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6c8d040a-e3ef-41b5-a01b-308767b52020 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:31.186320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6c8d040a-e3ef-41b5-a01b-308767b52020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:31.209548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:31.210561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.210855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.211140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] PATH_INFO: `/v3/projects/71100adccb244c7b93cf52873f64032a/users/390773c40dc9429d9708e085bc54c206/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.220217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 840/1689] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:31.224745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d040a-e3ef-41b5-a01b-308767b52020 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.242065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d040a-e3ef-41b5-a01b-308767b52020 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.251735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71100adccb244c7b93cf52873f64032a, user_id=390773c40dc9429d9708e085bc54c206, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:31.253856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:31.254851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.255392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.255876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.256652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:31.256954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:31.257328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:31.259587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:31.288773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 841/1690] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:31.297594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.300889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 850/1691] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:31 2022] PUT /identity/v3/projects/71100adccb244c7b93cf52873f64032a/users/390773c40dc9429d9708e085bc54c206/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:13:31.305113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.319808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb410-b842-4d1e-b47a-d58f39d960e5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.443093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d0b90-f985-49ac-b6cf-cc49036e93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:31.444171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d0b90-f985-49ac-b6cf-cc49036e93f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.444889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d0b90-f985-49ac-b6cf-cc49036e93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.445372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d0b90-f985-49ac-b6cf-cc49036e93f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.447941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d0b90-f985-49ac-b6cf-cc49036e93f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:31.457550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d0b90-f985-49ac-b6cf-cc49036e93f2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:31.544605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 842/1692] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:31 2022] POST /identity/v3/projects => generated 405 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:31.546012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947bcc-a6b9-46ff-91f4-2b20892b4728 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.546328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947bcc-a6b9-46ff-91f4-2b20892b4728 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.546673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947bcc-a6b9-46ff-91f4-2b20892b4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.579520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782de51-177d-443d-ba08-1c797f0d398c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.630117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f6947bcc-a6b9-46ff-91f4-2b20892b4728 None None] MFA Rules not processed for user `b0ff075d9612455a93a898413e8a948e`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:31.631905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f6947bcc-a6b9-46ff-91f4-2b20892b4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:31.715848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:31.716957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.717795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.719915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.720950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:31.725703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:31.751288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 851/1693] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:31.753176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.773994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:31.780146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce450-67e4-4ca6-a523-05046b2fa5d6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.801680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3b7c-7a94-4602-963e-dc26e266ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:31.804485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3b7c-7a94-4602-963e-dc26e266ea8e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.805505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3b7c-7a94-4602-963e-dc26e266ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.805982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3b7c-7a94-4602-963e-dc26e266ea8e admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.810255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3b7c-7a94-4602-963e-dc26e266ea8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:31.812566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3b7c-7a94-4602-963e-dc26e266ea8e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:31.858895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 843/1694] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:31.858895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6947bcc-a6b9-46ff-91f4-2b20892b4728 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.892548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 852/1695] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:31 2022] POST /identity/v3/users => generated 303 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:31.892772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6947bcc-a6b9-46ff-91f4-2b20892b4728 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.893520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241bcf-619f-4538-ba97-a91e36f358d1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.893826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241bcf-619f-4538-ba97-a91e36f358d1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.894120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241bcf-619f-4538-ba97-a91e36f358d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.903228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:31.904395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:31.904533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:31.904811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] PATH_INFO: `/v3/projects/71100adccb244c7b93cf52873f64032a/users/390773c40dc9429d9708e085bc54c206/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:31.909060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71100adccb244c7b93cf52873f64032a, user_id=390773c40dc9429d9708e085bc54c206, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:31.925667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:31.927171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f8241bcf-619f-4538-ba97-a91e36f358d1 None None] MFA Rules not processed for user `b0ff075d9612455a93a898413e8a948e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:31.928465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f8241bcf-619f-4538-ba97-a91e36f358d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:31.950057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 853/1696] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:31.950057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8241bcf-619f-4538-ba97-a91e36f358d1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.956235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 844/1697] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:31 2022] PUT /identity/v3/projects/71100adccb244c7b93cf52873f64032a/users/390773c40dc9429d9708e085bc54c206/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:31.966660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:31.972281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8241bcf-619f-4538-ba97-a91e36f358d1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:31.972485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:32.015724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:32.137410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d9faa-ed99-4033-bc8c-9ddacbea8286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:32.138011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9faa-ed99-4033-bc8c-9ddacbea8286 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.138410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9faa-ed99-4033-bc8c-9ddacbea8286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.138737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9faa-ed99-4033-bc8c-9ddacbea8286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.139436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d9faa-ed99-4033-bc8c-9ddacbea8286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:32.141085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d9faa-ed99-4033-bc8c-9ddacbea8286 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:32.159153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 854/1698] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:32.160922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31d0b-ba5a-4dec-9be6-b3c1d7e87526 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.161385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31d0b-ba5a-4dec-9be6-b3c1d7e87526 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.161919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31d0b-ba5a-4dec-9be6-b3c1d7e87526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.235818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7ae31d0b-ba5a-4dec-9be6-b3c1d7e87526 None None] MFA Rules not processed for user `390773c40dc9429d9708e085bc54c206`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:32.239251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7ae31d0b-ba5a-4dec-9be6-b3c1d7e87526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:32.253256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ebfa4-d395-4403-8357-129e00a7e762 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:32.269336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:32.271541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.271908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.272191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.444449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:32.446106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:32.463157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 855/1699] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:32.465214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719bc5-46b0-42ee-a8ea-f1b9ba77b405 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.465532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719bc5-46b0-42ee-a8ea-f1b9ba77b405 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.465779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719bc5-46b0-42ee-a8ea-f1b9ba77b405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.471615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 845/1700] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:32.473688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:32.509698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ad1c3-2aa4-44c7-98c4-290d6652486e service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:32.515258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d6719bc5-46b0-42ee-a8ea-f1b9ba77b405 None None] MFA Rules not processed for user `f1274aeb006048b790ab41824d999485`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:32.516679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d6719bc5-46b0-42ee-a8ea-f1b9ba77b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:32.518496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:32.519982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.520494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.520960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.526443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:32.530265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:32.562741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 846/1701] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:32.568404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:32.572441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:32.702394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 856/1702] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:32.703352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6588f-243d-410f-9a18-267f3a2b1a9e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:32.703499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6719bc5-46b0-42ee-a8ea-f1b9ba77b405 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:32.716819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6719bc5-46b0-42ee-a8ea-f1b9ba77b405 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:32.720909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843fe1d-ba29-4bbd-8ddc-4ff35b4c71f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:32.721592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fe1d-ba29-4bbd-8ddc-4ff35b4c71f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.721872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fe1d-ba29-4bbd-8ddc-4ff35b4c71f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.722151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fe1d-ba29-4bbd-8ddc-4ff35b4c71f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.722377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dda30-132a-4d9a-9fa2-45f1d2868c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:32.723445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dda30-132a-4d9a-9fa2-45f1d2868c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.723735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dda30-132a-4d9a-9fa2-45f1d2868c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.724015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dda30-132a-4d9a-9fa2-45f1d2868c55 admin admin] PATH_INFO: `/v3/projects/1f7138fccab945609b55b28bf60b6b58/users/e091c6b2edcc4fc1b6d96824ad0aed11/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.743872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dda30-132a-4d9a-9fa2-45f1d2868c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7138fccab945609b55b28bf60b6b58, user_id=e091c6b2edcc4fc1b6d96824ad0aed11, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:32.745258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:32.747172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dda30-132a-4d9a-9fa2-45f1d2868c55 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:32.756458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843fe1d-ba29-4bbd-8ddc-4ff35b4c71f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:32.761691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843fe1d-ba29-4bbd-8ddc-4ff35b4c71f7 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:32.776605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 857/1703] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:32 2022] PUT /identity/v3/projects/1f7138fccab945609b55b28bf60b6b58/users/e091c6b2edcc4fc1b6d96824ad0aed11/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:32.779341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.779722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.780159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.796669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 847/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:32.798327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd901b0-216e-4271-8010-39025a6900d0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:32.798619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd901b0-216e-4271-8010-39025a6900d0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:32.798900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd901b0-216e-4271-8010-39025a6900d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:32.801798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] MFA Rules not processed for user `f1274aeb006048b790ab41824d999485`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:32.803415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:32.810049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:32.871998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6cd901b0-216e-4271-8010-39025a6900d0 None None] MFA Rules not processed for user `e091c6b2edcc4fc1b6d96824ad0aed11`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:32.873297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6cd901b0-216e-4271-8010-39025a6900d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:32.934686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 858/1705] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:32.946365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:32.949812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:33.049784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 848/1706] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:33.050445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd901b0-216e-4271-8010-39025a6900d0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:33.102478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4577d-18ac-4f5c-82c5-95530205a33e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:33.111834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:33.113277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.113581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.113923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.129880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:33.132176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:33.155409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 859/1707] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:13:33.156475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:33.187114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd901b0-216e-4271-8010-39025a6900d0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:33.199998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:33.200714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.202034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.203001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.210963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:33.368486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb693b-1b3a-4385-b9f9-b803b11fb23c service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:33.382854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:33.386679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.386955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.387840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.388626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:33.391946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:33.429965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:33.433173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:33.445375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 849/1708] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:33.446700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:33.448883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:33.466116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79d2d4-8e39-4d8c-b220-151e0eb7c51b service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:33.479108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:33.480356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.480843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.482529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] PATH_INFO: `/v3/users/2ac1b102a0c44b578da86750d80c157c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.485116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac1b102a0c44b578da86750d80c157c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:33.489201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:33.500976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 860/1709] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:33 2022] POST /identity/v3/projects => generated 403 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:33.502981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:33.562014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:33.586495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac1b102a0c44b578da86750d80c157c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:33.587398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac1b102a0c44b578da86750d80c157c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:33.596238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac1b102a0c44b578da86750d80c157c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:33.597510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac1b102a0c44b578da86750d80c157c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:33.605328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:33.618468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-772c3dde-48ee-4186-9501-330c2c77651a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac1b102a0c44b578da86750d80c157c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:33.652850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 850/1710] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:33 2022] DELETE /identity/v3/users/2ac1b102a0c44b578da86750d80c157c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:33.654758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82f5c-3bad-492f-8524-2fd51cbae9ef None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.655147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82f5c-3bad-492f-8524-2fd51cbae9ef None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.655665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82f5c-3bad-492f-8524-2fd51cbae9ef None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.660476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 851/1711] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jul 21 10:13:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:33.676413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86632-0d9c-49a7-a205-b6b814c0866f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.677312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11318-ff1a-45b6-af90-d265332a790c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:33.677445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86632-0d9c-49a7-a205-b6b814c0866f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.677830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86632-0d9c-49a7-a205-b6b814c0866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.708704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-28d86632-0d9c-49a7-a205-b6b814c0866f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:33.710917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-28d86632-0d9c-49a7-a205-b6b814c0866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:33.827093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 852/1712] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:33.830290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d0b4d-f5ec-4595-b4b3-cac124ffdb65 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.830290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d0b4d-f5ec-4595-b4b3-cac124ffdb65 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.830290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d0b4d-f5ec-4595-b4b3-cac124ffdb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.904234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:33.904927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:33.905218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:33.905493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:33.906227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:33.908163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:33.919079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4f4d0b4d-f5ec-4595-b4b3-cac124ffdb65 None None] MFA Rules not processed for user `dc579eaf4c3e4ea5a77063ba5f3d4b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:33.921596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4f4d0b4d-f5ec-4595-b4b3-cac124ffdb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:33.948362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 861/1713] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:33 2022] POST /identity/v3/users => generated 308 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:33.948362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:33.958603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:34.087431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 853/1714] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:13:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:34.095177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f152f-4d10-42c1-9e32-202609cca218 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.095473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f152f-4d10-42c1-9e32-202609cca218 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.095755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f152f-4d10-42c1-9e32-202609cca218 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.097159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 854/1715] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jul 21 10:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:34.109738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f152f-4d10-42c1-9e32-202609cca218 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:34.121829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-210f152f-4d10-42c1-9e32-202609cca218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:34.129433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cab2-32a2-4703-accd-57da3fe95c2c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:34.148333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:34.149043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.149327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.149607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.172262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f152f-4d10-42c1-9e32-202609cca218 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:34.174410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:34.175862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:34.185102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb8be-e2c5-4727-8f76-8fcec402e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:34.185879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb8be-e2c5-4727-8f76-8fcec402e434 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.186082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb8be-e2c5-4727-8f76-8fcec402e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.186391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb8be-e2c5-4727-8f76-8fcec402e434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.187151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb8be-e2c5-4727-8f76-8fcec402e434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:34.189535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb8be-e2c5-4727-8f76-8fcec402e434 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:34.198088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 862/1716] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:34.198801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:34.200184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:34.210534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 855/1717] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:34.218717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683cfb-5341-446a-84c1-44bfda116add None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.219084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683cfb-5341-446a-84c1-44bfda116add None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.219381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683cfb-5341-446a-84c1-44bfda116add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.231223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8ccb3-bad3-47ae-8009-9c1b7e8953f6 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:34.235630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:34.236300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.236583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.236859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.256554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e5683cfb-5341-446a-84c1-44bfda116add None None] MFA Rules not processed for user `dc579eaf4c3e4ea5a77063ba5f3d4b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:34.258123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e5683cfb-5341-446a-84c1-44bfda116add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:34.261812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:34.263509 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:34.275093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 856/1718] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:34.277760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5683cfb-5341-446a-84c1-44bfda116add None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:34.281838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 863/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:34.282499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:34.297792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2f6-8d71-44f1-84b7-29e187454944 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:34.300549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5683cfb-5341-446a-84c1-44bfda116add None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:34.307348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:34.308675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.309356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.309783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] PATH_INFO: `/v3/projects/b7db60c90c4a4038a6e296d74becc83a/users/61b14e6ea81b4d66be904a3462851774/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.315818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:34.316497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.316777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.317051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.334568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7db60c90c4a4038a6e296d74becc83a, user_id=61b14e6ea81b4d66be904a3462851774, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:34.336565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:34.337755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:34.338001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:34.352781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 864/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:34.365680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 857/1721] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:34 2022] PUT /identity/v3/projects/b7db60c90c4a4038a6e296d74becc83a/users/61b14e6ea81b4d66be904a3462851774/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:34.366686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:34.393436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1d1fc-0a83-4211-81d6-3a70ea678bde service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:34.487656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:34.535988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1e6b-8e3c-481e-b11a-9e0dc427b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:34.536977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1e6b-8e3c-481e-b11a-9e0dc427b0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.539411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1e6b-8e3c-481e-b11a-9e0dc427b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.539699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1e6b-8e3c-481e-b11a-9e0dc427b0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.540512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b1e6b-8e3c-481e-b11a-9e0dc427b0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:34.548237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b1e6b-8e3c-481e-b11a-9e0dc427b0d0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:34.611866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 865/1722] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:34.615741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:34.635054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0149-341c-4c6c-acbc-f1c60f95eca3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:34.662769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:34.663715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.664003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.664281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] PATH_INFO: `/v3/projects/b7db60c90c4a4038a6e296d74becc83a/users/61b14e6ea81b4d66be904a3462851774/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.670491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7db60c90c4a4038a6e296d74becc83a, user_id=61b14e6ea81b4d66be904a3462851774, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:34.681754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:34.693731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:34.716811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 858/1723] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:34 2022] PUT /identity/v3/projects/b7db60c90c4a4038a6e296d74becc83a/users/61b14e6ea81b4d66be904a3462851774/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:13:34.735469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:34.735770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:34.736058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:34.799444 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] MFA Rules not processed for user `61b14e6ea81b4d66be904a3462851774`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:34.806148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:35.057369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 866/1724] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:35.075752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:35.077792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:35.214830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a371-ca41-4a81-b624-a348bdd0ae24 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:35.235764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:35.239029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:35.240325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:35.241286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:35.272160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:35.276603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:35.309418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:35.311430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:35.331874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 859/1725] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:13:35.579828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd677f-0cad-4181-8846-0482dec21999 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:35.602876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:35.604398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:35.604724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:35.605070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] PATH_INFO: `/v3/projects/a14fc570d3b44b0bafa27d95f2cc44c6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:35.608700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14fc570d3b44b0bafa27d95f2cc44c6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:35.618297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:35.732212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14fc570d3b44b0bafa27d95f2cc44c6', 'request_id': 'req-558b563d-7349-4bfb-9887-71317a988ed9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:35.751608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14fc570d3b44b0bafa27d95f2cc44c6', 'request_id': 'req-558b563d-7349-4bfb-9887-71317a988ed9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:35.772808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14fc570d3b44b0bafa27d95f2cc44c6', 'request_id': 'req-558b563d-7349-4bfb-9887-71317a988ed9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:35.776560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:35.813415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] The token cache is being invalidate because project a14fc570d3b44b0bafa27d95f2cc44c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:35.820732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:35.840740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-558b563d-7349-4bfb-9887-71317a988ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:35.844323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 867/1726] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:35 2022] DELETE /identity/v3/projects/a14fc570d3b44b0bafa27d95f2cc44c6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:35.848430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:35.864672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845a53b-e04f-4322-8d55-aae93aeba4d4 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:35.918346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ec1b-0006-435a-b80c-347290ef2309 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:35.918346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ec1b-0006-435a-b80c-347290ef2309 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:35.918346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ec1b-0006-435a-b80c-347290ef2309 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:35.922836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 868/1727] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jul 21 10:13:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:35.927951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:35.928241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:35.928516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:36.007637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:36.008954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:36.086327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:36.087268 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:36.087552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:36.087825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] PATH_INFO: `/v3/users/c77894b3e5204f739c560be73d8996a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:36.095854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77894b3e5204f739c560be73d8996a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:36.118757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:36.293369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77894b3e5204f739c560be73d8996a0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.294160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77894b3e5204f739c560be73d8996a0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.310004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77894b3e5204f739c560be73d8996a0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.311153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77894b3e5204f739c560be73d8996a0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.333721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3491210f-e709-43e3-a09f-ea55c96e65cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77894b3e5204f739c560be73d8996a0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.341772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 869/1728] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jul 21 10:13:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:36.343721 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:36.348040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:36.386373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd05e71-e6a7-4daf-be16-af24d979ec30 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:36.394598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:36.395560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:36.395848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:36.396184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] PATH_INFO: `/v3/users/e091c6b2edcc4fc1b6d96824ad0aed11` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:36.397999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e091c6b2edcc4fc1b6d96824ad0aed11)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:36.400157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:36.407386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 860/1729] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:35 2022] DELETE /identity/v3/users/c77894b3e5204f739c560be73d8996a0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:36.423164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:36.423564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:36.423826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:36.540070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] MFA Rules not processed for user `cb3146ed5b1947ee99cba2e95a777a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:36.542832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:36.546327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e091c6b2edcc4fc1b6d96824ad0aed11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.558539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:36.603210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e091c6b2edcc4fc1b6d96824ad0aed11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.645388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e091c6b2edcc4fc1b6d96824ad0aed11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.660552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e091c6b2edcc4fc1b6d96824ad0aed11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.665445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a43257dd-7d64-4cfa-be6c-fad12475dc8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e091c6b2edcc4fc1b6d96824ad0aed11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:36.688332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 870/1730] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:36 2022] DELETE /identity/v3/users/e091c6b2edcc4fc1b6d96824ad0aed11 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:36.693951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:36.694263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:36.694580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:36.721821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] MFA Rules not processed for user `b0ff075d9612455a93a898413e8a948e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:36.723322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:36.769950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 861/1731] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:36.771626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:36.775407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:36.908926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 871/1732] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:36.909977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:36.915309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:36.934205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:36.984347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a2f0-5855-418c-9d2e-c40187f29199 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:37.105043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18cad9-0039-4373-a83b-fb872133b5b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:37.105778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18cad9-0039-4373-a83b-fb872133b5b0 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:37.106016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18cad9-0039-4373-a83b-fb872133b5b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:37.110878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18cad9-0039-4373-a83b-fb872133b5b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:37.115289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc18cad9-0039-4373-a83b-fb872133b5b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:37.146916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18cad9-0039-4373-a83b-fb872133b5b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:37.149365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ea97-085f-4a52-a313-13d4b45ce950 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:37.151343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18cad9-0039-4373-a83b-fb872133b5b0 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:37.157820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:37.159232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:37.159476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:37.159856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:37.177981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:37.179299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 862/1733] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:37.181736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:37.182880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:37.183203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:37.183491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:37.236729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 872/1734] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:37.239116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:37.243485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:37.250957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:37.252249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:37.395616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:37.492290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 863/1735] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:37.517894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75b399-2001-475e-8b7d-28ae34706fbb service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:37.537637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:37.539526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:37.539526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:37.539723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:37.685902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:37.687483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:37.837075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:37.839337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:37.889804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 873/1736] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:37.891609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:37.893930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:37.951311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da435e-e54b-4ef6-b3eb-7d7fea6a2a54 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:37.969048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1bded-44a7-437c-b6cd-59bdfe7005bd service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:37.972202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135365c-3c74-4278-bf0c-9020ec62eca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:37.972879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135365c-3c74-4278-bf0c-9020ec62eca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:37.973163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135365c-3c74-4278-bf0c-9020ec62eca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:37.973440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135365c-3c74-4278-bf0c-9020ec62eca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:37.985398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:37.987710 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:37.987997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:37.988380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] PATH_INFO: `/v3/projects/36f28103b12f4317a44c6e8e61c798e2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:37.997872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f28103b12f4317a44c6e8e61c798e2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:38.003325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:38.011703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135365c-3c74-4278-bf0c-9020ec62eca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:38.013990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135365c-3c74-4278-bf0c-9020ec62eca1 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:38.068568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 864/1737] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:13:38.169564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:38.223427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f28103b12f4317a44c6e8e61c798e2', 'request_id': 'req-3aba092b-b504-467a-9340-9e94b84ba855'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:38.235162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f28103b12f4317a44c6e8e61c798e2', 'request_id': 'req-3aba092b-b504-467a-9340-9e94b84ba855'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:38.248629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f28103b12f4317a44c6e8e61c798e2', 'request_id': 'req-3aba092b-b504-467a-9340-9e94b84ba855'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:38.280689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] The token cache is being invalidate because project 36f28103b12f4317a44c6e8e61c798e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:38.280993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:38.294920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:38.304437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 874/1738] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:37 2022] DELETE /identity/v3/projects/36f28103b12f4317a44c6e8e61c798e2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:38.311786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d742f61-6ff2-4f2d-a894-304637e72210 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:38.312055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d742f61-6ff2-4f2d-a894-304637e72210 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:38.312339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d742f61-6ff2-4f2d-a894-304637e72210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:38.376083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4d742f61-6ff2-4f2d-a894-304637e72210 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:38.378506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4d742f61-6ff2-4f2d-a894-304637e72210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:38.387203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:38.388709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:38.698474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba092b-b504-467a-9340-9e94b84ba855 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:38.719885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:38.728470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:38.732812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:38.733289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] PATH_INFO: `/v3/users/c2744979411e4e1383e4212739b937dc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:38.738106 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2744979411e4e1383e4212739b937dc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:38.740555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:38.794035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 865/1739] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:38.806213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22f14-32b2-4c15-9560-a503d647022d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:38.807336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22f14-32b2-4c15-9560-a503d647022d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:38.807769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22f14-32b2-4c15-9560-a503d647022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:38.883518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1bf22f14-32b2-4c15-9560-a503d647022d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:38.885519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1bf22f14-32b2-4c15-9560-a503d647022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:38.930689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2744979411e4e1383e4212739b937dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:38.936127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 866/1740] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:38.941120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf22f14-32b2-4c15-9560-a503d647022d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:38.991566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf22f14-32b2-4c15-9560-a503d647022d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:39.003103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2744979411e4e1383e4212739b937dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:39.015112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:39.015822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:39.016077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:39.016352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:39.017093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:39.017396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:39.019072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:39.038859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2744979411e4e1383e4212739b937dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:39.066248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2744979411e4e1383e4212739b937dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:39.067041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2217463-1590-4f6c-92f0-ec8695fa9eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2744979411e4e1383e4212739b937dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:39.082234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 867/1741] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:39.088931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:39.089403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 875/1742] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:38 2022] DELETE /identity/v3/users/c2744979411e4e1383e4212739b937dc => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:39.090152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:39.091418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:39.092103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:39.092598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:39.128130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3479d-1892-440f-9688-cc1106e97e96 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:39.190419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:39.193914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:39.303540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:39.303974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:39.304261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:39.304541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:39.305591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:39.308889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:39.324444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:39.372089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:39.387576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 868/1743] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:39 2022] POST /identity/v3/projects => generated 383 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:39.394755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:39.500417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 876/1744] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:39.668964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:39.670886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:39.697112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65315a85-e9e1-4cb2-a81f-6fcc3dd264b1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:39.723509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:39.724334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:39.739656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:39.740219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:39.741232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:39.756801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:39.808674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 869/1745] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:39 2022] POST /identity/v3/users => generated 292 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:39.809985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:39.817649 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:39.857343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84352e9-45bb-48ee-a538-6194288f0b2f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:39.864966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:39.866516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:39.867015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:39.867500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] PATH_INFO: `/v3/users/16432ec198f24951a63894bfb67b012d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:39.870962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16432ec198f24951a63894bfb67b012d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:39.873911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:39.891898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc1e67-af41-45d8-a917-53d82c09a295 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:40.026367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16432ec198f24951a63894bfb67b012d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:40.027853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16432ec198f24951a63894bfb67b012d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:40.052863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16432ec198f24951a63894bfb67b012d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:40.053833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16432ec198f24951a63894bfb67b012d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:40.071201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16432ec198f24951a63894bfb67b012d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:40.085420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddda413-7109-4fe5-800d-0b4a5e4a0764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:40.087229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda413-7109-4fe5-800d-0b4a5e4a0764 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:40.094423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda413-7109-4fe5-800d-0b4a5e4a0764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:40.094811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda413-7109-4fe5-800d-0b4a5e4a0764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:40.099904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ddda413-7109-4fe5-800d-0b4a5e4a0764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:40.132715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 870/1746] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:39 2022] DELETE /identity/v3/users/16432ec198f24951a63894bfb67b012d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:40.133530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:40.137511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:40.157811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddda413-7109-4fe5-800d-0b4a5e4a0764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:40.159229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddda413-7109-4fe5-800d-0b4a5e4a0764 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:40.183075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 877/1747] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:40.184575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:40.184859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:40.185151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:40.225908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:40.230839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:40.281589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:40.338899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d81c2c-2ae6-4f50-a471-44171aa9a4b8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:40.344480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:40.345332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:40.345782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:40.346195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:40.347089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:40.349042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:40.363110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 871/1748] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:40.367448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:40.391294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 878/1749] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:40.423480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:40.425075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:40.429900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13b8c-0a23-409f-910b-2bb6d002db7a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:40.444151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:40.444858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:40.445148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:40.445422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:40.446196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:40.448479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:40.520030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 872/1750] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:13:40.525365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:40.542546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:40.553314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ea18b-680c-4ed5-ac32-e3c32c276418 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:40.603115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfb589-c94f-4902-9818-fd337cda7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:40.606085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfb589-c94f-4902-9818-fd337cda7bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:40.606400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfb589-c94f-4902-9818-fd337cda7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:40.606754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfb589-c94f-4902-9818-fd337cda7bd9 admin admin] PATH_INFO: `/v3/projects/03881e0e1e9e48a886c161f3247dc7ff/users/0dea7d660f1f4ff8919c527d7b7f0927/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:40.613425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ec316-ea30-4a10-b04a-69a518d86d78 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:40.627612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df981-2048-4d29-901d-fcabc6ea92b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:40.629102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df981-2048-4d29-901d-fcabc6ea92b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:40.629428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df981-2048-4d29-901d-fcabc6ea92b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:40.630987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df981-2048-4d29-901d-fcabc6ea92b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:40.653556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfb589-c94f-4902-9818-fd337cda7bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03881e0e1e9e48a886c161f3247dc7ff, user_id=0dea7d660f1f4ff8919c527d7b7f0927, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:40.664156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfb589-c94f-4902-9818-fd337cda7bd9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:40.668921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71df981-2048-4d29-901d-fcabc6ea92b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:40.683258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71df981-2048-4d29-901d-fcabc6ea92b0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:40.718712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 879/1751] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:13:40.724171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 873/1752] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:40 2022] PUT /identity/v3/projects/03881e0e1e9e48a886c161f3247dc7ff/users/0dea7d660f1f4ff8919c527d7b7f0927/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:40.748954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc50b57-dce0-4b41-97c8-887df9593ecb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:40.749588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc50b57-dce0-4b41-97c8-887df9593ecb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:40.750539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc50b57-dce0-4b41-97c8-887df9593ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:40.841715 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2bc50b57-dce0-4b41-97c8-887df9593ecb None None] MFA Rules not processed for user `0dea7d660f1f4ff8919c527d7b7f0927`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:40.843749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2bc50b57-dce0-4b41-97c8-887df9593ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:41.053766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:41.053766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:41.053766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:41.071958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 880/1753] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:41.076971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc50b57-dce0-4b41-97c8-887df9593ecb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:41.120926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] MFA Rules not processed for user `b3e73f3002da4da3b94cb17f837defb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:41.128014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:41.327342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 874/1754] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:13:41.328954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:41.334423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc50b57-dce0-4b41-97c8-887df9593ecb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:41.335731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:41.348481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:41.349326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:41.349793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:41.350108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:41.351399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:41.357477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:41.422311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 881/1755] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:41 2022] POST /identity/v3/projects => generated 385 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:41.423333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:41.427343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c531c-1258-4b2e-a711-5db06e33b736 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:41.427741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:41.643642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:41.644904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:41.647639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:41.648207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] PATH_INFO: `/v3/projects/1f7138fccab945609b55b28bf60b6b58` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:41.651590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7138fccab945609b55b28bf60b6b58)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:41.654505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:41.659556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:41.699377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4721e-8ab1-4925-a03d-436f91162ee3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:41.716912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:41.720960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:41.721435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:41.721735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] PATH_INFO: `/v3/projects/e4bb5615a03f42a4a19961dba0186b6d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:41.725917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bb5615a03f42a4a19961dba0186b6d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:41.740065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:41.823342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:41.854002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7138fccab945609b55b28bf60b6b58', 'request_id': 'req-32d16cc5-0165-42af-97b8-1f5529682784'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.875166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bb5615a03f42a4a19961dba0186b6d', 'request_id': 'req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.878515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7138fccab945609b55b28bf60b6b58', 'request_id': 'req-32d16cc5-0165-42af-97b8-1f5529682784'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.894066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7138fccab945609b55b28bf60b6b58', 'request_id': 'req-32d16cc5-0165-42af-97b8-1f5529682784'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.894514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bb5615a03f42a4a19961dba0186b6d', 'request_id': 'req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.913838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bb5615a03f42a4a19961dba0186b6d', 'request_id': 'req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.942971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] The token cache is being invalidate because project e4bb5615a03f42a4a19961dba0186b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:41.943271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.944351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] The token cache is being invalidate because project 1f7138fccab945609b55b28bf60b6b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:41.944896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.946061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.946710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:41.951400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 882/1756] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:41 2022] DELETE /identity/v3/projects/e4bb5615a03f42a4a19961dba0186b6d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:41.951400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:41.951651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 875/1757] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:41 2022] DELETE /identity/v3/projects/1f7138fccab945609b55b28bf60b6b58 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:41.953849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:41.954709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:41.955630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:42.080878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0f52c-4a95-4ad7-8712-38cde659a4d8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:42.102668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:42.104102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:42.104443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:42.104731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:42.105463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:42.107735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:42.157342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16cc5-0165-42af-97b8-1f5529682784 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:42.180999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:42.184394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:42.184906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:42.185354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] PATH_INFO: `/v3/users/c7bbe4e293eb49e58d364f921153a58c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:42.187946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bbe4e293eb49e58d364f921153a58c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:42.191885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:42.231800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 883/1758] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:41 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:42.233124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:42.238973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:42.261732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030665-f051-46b9-bfd6-b1e34834831b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:42.267353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:42.268261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:42.268548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:42.268829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] PATH_INFO: `/v3/users/61b14e6ea81b4d66be904a3462851774` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:42.270360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b14e6ea81b4d66be904a3462851774)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:42.272592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:42.384528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bbe4e293eb49e58d364f921153a58c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.387178 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bbe4e293eb49e58d364f921153a58c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.399427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b14e6ea81b4d66be904a3462851774'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.402274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bbe4e293eb49e58d364f921153a58c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.403564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bbe4e293eb49e58d364f921153a58c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.419931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bbe4e293eb49e58d364f921153a58c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.462454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b14e6ea81b4d66be904a3462851774'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.467233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:42.488806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 876/1759] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:41 2022] DELETE /identity/v3/users/c7bbe4e293eb49e58d364f921153a58c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:42.490931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:42.491807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b14e6ea81b4d66be904a3462851774'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.499575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:42.518098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b14e6ea81b4d66be904a3462851774'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.522282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b14e6ea81b4d66be904a3462851774'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:42.551972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 884/1760] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:42 2022] DELETE /identity/v3/users/61b14e6ea81b4d66be904a3462851774 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:42.557272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:42.563312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:42.702123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:42.747602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a6ac-184f-454d-9515-db49622cdc7b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:42.753881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ae0af-eb41-470e-9432-3826b81d9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:42.754827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ae0af-eb41-470e-9432-3826b81d9876 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:42.755250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ae0af-eb41-470e-9432-3826b81d9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:42.755694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ae0af-eb41-470e-9432-3826b81d9876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:42.756584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ae0af-eb41-470e-9432-3826b81d9876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:42.758798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ae0af-eb41-470e-9432-3826b81d9876 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:42.782865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 885/1761] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:42.784262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344de4a-a686-4cf4-a174-5a67d4ff5b3d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:42.784552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344de4a-a686-4cf4-a174-5a67d4ff5b3d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:42.784830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344de4a-a686-4cf4-a174-5a67d4ff5b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:42.793168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0694e6f-9724-406d-8167-1a9fb4bc463a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:42.897685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:42.898434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:42.898724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:42.899003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:42.902061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:42.919769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4344de4a-a686-4cf4-a174-5a67d4ff5b3d None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:42.921020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4344de4a-a686-4cf4-a174-5a67d4ff5b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:43.052524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:43.054729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:43.066388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 886/1762] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:43.072996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344de4a-a686-4cf4-a174-5a67d4ff5b3d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:43.083706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 877/1763] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:43.107709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344de4a-a686-4cf4-a174-5a67d4ff5b3d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:43.114547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:43.115491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:43.115892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:43.116177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] PATH_INFO: `/v3/projects/f31615cb458d4569b2c34fe4b6dae54b/users/e4c5d47ae7a94c009d2ab8f8885944ff/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:43.164361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31615cb458d4569b2c34fe4b6dae54b, user_id=e4c5d47ae7a94c009d2ab8f8885944ff, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:43.167684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:43.202630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 887/1764] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:43 2022] PUT /identity/v3/projects/f31615cb458d4569b2c34fe4b6dae54b/users/e4c5d47ae7a94c009d2ab8f8885944ff/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:43.207029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:43.221135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862c029-5841-4e2e-95ce-4bd91408bdd3 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:43.260710 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:43.263046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:43.343565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:43.471481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:43.472956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:43.474849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:43.475313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:43.477055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:43.481296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:43.513144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 878/1765] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:43.514348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:43.528218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a51ecd-3daf-4655-b456-a68e6607d7e8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:43.538790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa9f6-80da-4335-bf81-39b60d605315 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:43.545152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ba9aa-95e9-4b4b-9b4d-5afc5b5ba063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:43.547492 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ba9aa-95e9-4b4b-9b4d-5afc5b5ba063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:43.548007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ba9aa-95e9-4b4b-9b4d-5afc5b5ba063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:43.548675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ba9aa-95e9-4b4b-9b4d-5afc5b5ba063 admin admin] PATH_INFO: `/v3/projects/f31615cb458d4569b2c34fe4b6dae54b/users/e4c5d47ae7a94c009d2ab8f8885944ff/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:43.555724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:43.556738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:43.557718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:43.558220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:43.562085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ba9aa-95e9-4b4b-9b4d-5afc5b5ba063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31615cb458d4569b2c34fe4b6dae54b, user_id=e4c5d47ae7a94c009d2ab8f8885944ff, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:43.568082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ba9aa-95e9-4b4b-9b4d-5afc5b5ba063 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:43.605822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 879/1766] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:43 2022] PUT /identity/v3/projects/f31615cb458d4569b2c34fe4b6dae54b/users/e4c5d47ae7a94c009d2ab8f8885944ff/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:43.608014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:43.608389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:43.608766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:43.646878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:43.696578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] MFA Rules not processed for user `e4c5d47ae7a94c009d2ab8f8885944ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:43.699458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:43.739156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:43.740541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:43.752132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 888/1767] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:13:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:13:44.063404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 880/1768] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:44.072088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:44.073706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:44.318666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dc6d1-973e-4eef-86bd-9300f1da730b service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:44.324750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:44.326602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:44.466708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:44.481798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:44.482217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:44.482755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:44.501483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:44.575515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:44.576473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f01007-dff4-44b3-bbea-b3ab08e43b7d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:44.594536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:44.595698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:44.595809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:44.596075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] PATH_INFO: `/v3/projects/8b94474628aa4246b5dbb71a9f3a3ff9` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:44.602794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b94474628aa4246b5dbb71a9f3a3ff9)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:44.611130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:44.777118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:44.784749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:44.821060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 889/1769] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:44.853883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b94474628aa4246b5dbb71a9f3a3ff9', 'request_id': 'req-4ecee48d-b446-4131-b1b5-35d49f27c8ad'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:44.880746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b94474628aa4246b5dbb71a9f3a3ff9', 'request_id': 'req-4ecee48d-b446-4131-b1b5-35d49f27c8ad'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:44.915874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b94474628aa4246b5dbb71a9f3a3ff9', 'request_id': 'req-4ecee48d-b446-4131-b1b5-35d49f27c8ad'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:44.970660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] The token cache is being invalidate because project 8b94474628aa4246b5dbb71a9f3a3ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:44.970991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:44.976932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4ecee48d-b446-4131-b1b5-35d49f27c8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:44.990045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 881/1770] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:44 2022] DELETE /identity/v3/projects/8b94474628aa4246b5dbb71a9f3a3ff9 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:13:44.992460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:45.024558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49971177-2a72-411f-ae86-397fa2ed2073 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:45.178022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:45.180061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:45.180500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:45.180970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] PATH_INFO: `/v3/users/390773c40dc9429d9708e085bc54c206` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:45.183753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=390773c40dc9429d9708e085bc54c206)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:45.188136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:45.332166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390773c40dc9429d9708e085bc54c206'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:45.395875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390773c40dc9429d9708e085bc54c206'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:45.410945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390773c40dc9429d9708e085bc54c206'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:45.432122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390773c40dc9429d9708e085bc54c206'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:45.434061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390773c40dc9429d9708e085bc54c206'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:45.454971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 890/1771] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:44 2022] DELETE /identity/v3/users/390773c40dc9429d9708e085bc54c206 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:46.209556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:46.210204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:46.210656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:46.290456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] MFA Rules not processed for user `dc579eaf4c3e4ea5a77063ba5f3d4b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:46.293899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:46.339759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:46.508960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 882/1772] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 21 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:46.750758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:46.752437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:46.785811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44925-52be-4c4a-bb55-b306726a2abb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:46.800322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:46.801021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:46.801310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:46.801593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:46.830448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:46.832204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:46.866864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 891/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:47.693534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:47.695427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:48.026783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332eb5-765d-40fe-8506-0ed51cd0a349 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:48.042942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:48.078075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.078403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.078671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] PATH_INFO: `/v3/projects/b7db60c90c4a4038a6e296d74becc83a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.084810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7db60c90c4a4038a6e296d74becc83a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:48.090988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:48.214532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:48.218001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:48.252376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7db60c90c4a4038a6e296d74becc83a', 'request_id': 'req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.264069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b706de5-5bfd-4f13-84c6-a05bbdbdafb0 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:48.268368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7db60c90c4a4038a6e296d74becc83a', 'request_id': 'req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.282670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7db60c90c4a4038a6e296d74becc83a', 'request_id': 'req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.314684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] The token cache is being invalidate because project b7db60c90c4a4038a6e296d74becc83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:48.314913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.330383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f36b499c-d88f-4de8-8307-0c5f4f6dc1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.336039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 883/1774] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:47 2022] DELETE /identity/v3/projects/b7db60c90c4a4038a6e296d74becc83a => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:48.337664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:48.341212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9292c-5636-4128-8e12-0b6fe1059202 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.341498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9292c-5636-4128-8e12-0b6fe1059202 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.341809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9292c-5636-4128-8e12-0b6fe1059202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.386870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8ac9292c-5636-4128-8e12-0b6fe1059202 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:48.388420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8ac9292c-5636-4128-8e12-0b6fe1059202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:48.475382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:48.488499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.489171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.489726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] PATH_INFO: `/v3/projects/913100ee5fa24703aa6619bf1fa8909d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.498753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913100ee5fa24703aa6619bf1fa8909d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:48.501164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:48.564166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 884/1775] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:48.572613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca8af-4789-4b8d-936a-0eb8692d89f2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.573397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca8af-4789-4b8d-936a-0eb8692d89f2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.573681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca8af-4789-4b8d-936a-0eb8692d89f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.608999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:48.642359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9d7ca8af-4789-4b8d-936a-0eb8692d89f2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:48.645619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9d7ca8af-4789-4b8d-936a-0eb8692d89f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:48.710876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913100ee5fa24703aa6619bf1fa8909d', 'request_id': 'req-88513913-6095-412b-a76a-34a016dd7d44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.725519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913100ee5fa24703aa6619bf1fa8909d', 'request_id': 'req-88513913-6095-412b-a76a-34a016dd7d44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.744522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913100ee5fa24703aa6619bf1fa8909d', 'request_id': 'req-88513913-6095-412b-a76a-34a016dd7d44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.796904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 885/1776] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:48.800389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] The token cache is being invalidate because project 913100ee5fa24703aa6619bf1fa8909d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:48.801189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.801455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca8af-4789-4b8d-936a-0eb8692d89f2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:48.806365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88513913-6095-412b-a76a-34a016dd7d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:48.813751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 892/1777] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:48 2022] DELETE /identity/v3/projects/913100ee5fa24703aa6619bf1fa8909d => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:48.823094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd76942-bd5c-4eef-8271-e5241a4bcc45 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.823554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd76942-bd5c-4eef-8271-e5241a4bcc45 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.823969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd76942-bd5c-4eef-8271-e5241a4bcc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.842530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca8af-4789-4b8d-936a-0eb8692d89f2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:48.851993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:48.852740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.853031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.853839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.854842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:48.854997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:48.856656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:48.888112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ffd76942-bd5c-4eef-8271-e5241a4bcc45 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:48.895042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ffd76942-bd5c-4eef-8271-e5241a4bcc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:48.898334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 886/1778] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:48.904713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:48.915520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:48.931269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 893/1779] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:48.945586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0a58-0c1d-48e0-8977-2490937019a3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.947932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0a58-0c1d-48e0-8977-2490937019a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.951296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34dbf8-99c7-4521-947d-56f44dfd6757 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:48.951840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0a58-0c1d-48e0-8977-2490937019a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.968679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:48.970937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:48.971372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:48.971751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:48.977038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:48.987432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.004518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-711f0a58-0c1d-48e0-8977-2490937019a3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:49.005767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-711f0a58-0c1d-48e0-8977-2490937019a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:49.022668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 894/1780] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:49.027992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0a58-0c1d-48e0-8977-2490937019a3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.041709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0a58-0c1d-48e0-8977-2490937019a3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.049693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.050776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.051149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.051517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.052876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:49.053824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.056229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.062806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 887/1781] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:48 2022] POST /identity/v3/projects => generated 355 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:49.066715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.080348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 895/1782] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:49.081469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.099008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bf4fa-33e6-4b3a-be24-e38dad7dbf3a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.268570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adf5fa-83e6-4e89-9824-27f43a94ae44 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.301301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.301542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.301729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.303387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.306127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.313225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.364441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 888/1783] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:49 2022] POST /identity/v3/users => generated 278 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:13:49.370357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.373980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.374700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.374988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.387659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.390565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.396888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39c15b-f1b3-4857-861c-f46b79d3aa09 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.406280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.408557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.409286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.409566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.409843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.423775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.433210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.461163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 889/1784] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:49.465082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.508108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 896/1785] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:49 2022] POST /identity/v3/projects => generated 365 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:49.508262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bac09-33f9-4e56-bf29-653c5fbd1c43 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.509629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.534119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:49.670439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:49.718104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.719127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.722691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.723210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.725986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.728141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.738694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1be296-6d8b-44be-b18d-32a6d3703270 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.762387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.763447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.764438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.765085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.765829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.785983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 890/1786] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:49.787312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.792335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.838611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1bea-86e9-40cf-9fb9-d237cbaa7709 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.863227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70015ac-d1a5-4db2-9d54-c0f5b2fd0f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.864148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70015ac-d1a5-4db2-9d54-c0f5b2fd0f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.864763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70015ac-d1a5-4db2-9d54-c0f5b2fd0f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.864763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70015ac-d1a5-4db2-9d54-c0f5b2fd0f30 admin admin] PATH_INFO: `/v3/projects/1e22ac7bf216421189733427196b4514/users/df439db17b6f4028b19010b7191c20da/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.889626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 897/1787] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:49 2022] POST /identity/v3/users => generated 283 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:49.891095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:49.920378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc546-af1b-42b7-b1ee-0afbe6229d82 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:49.936436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:49.937018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:49.937353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:49.937578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:49.941875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.943672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.967975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70015ac-d1a5-4db2-9d54-c0f5b2fd0f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e22ac7bf216421189733427196b4514, user_id=df439db17b6f4028b19010b7191c20da, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:49.970861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70015ac-d1a5-4db2-9d54-c0f5b2fd0f30 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:49.983583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 898/1788] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:49.984787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:50.013870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 891/1789] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:49 2022] PUT /identity/v3/projects/1e22ac7bf216421189733427196b4514/users/df439db17b6f4028b19010b7191c20da/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:13:50.014515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3780f-3645-4966-b675-3951c6096cce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:50.029500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dbe7b-55e0-4e2c-bc4b-cff5528b7067 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:50.029875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dbe7b-55e0-4e2c-bc4b-cff5528b7067 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:50.030145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dbe7b-55e0-4e2c-bc4b-cff5528b7067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:50.172352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-131dbe7b-55e0-4e2c-bc4b-cff5528b7067 None None] MFA Rules not processed for user `df439db17b6f4028b19010b7191c20da`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:50.183782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-131dbe7b-55e0-4e2c-bc4b-cff5528b7067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:50.358251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:50.358974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:50.359313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:50.359606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:50.376001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:50.409736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:50.441306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 892/1790] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:50.448393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dbe7b-55e0-4e2c-bc4b-cff5528b7067 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:50.481407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dbe7b-55e0-4e2c-bc4b-cff5528b7067 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:50.490693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 899/1791] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:50.496758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:50.519308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:50.520173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:50.520618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:50.521043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:50.521884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:50.524025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:50.547016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537231eb-c545-441e-ae0b-ff7d6b9b2be8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:50.593856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 893/1792] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:50 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:50.608657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:50.614788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75050-720e-4838-bcc8-0ee1b43b8da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:50.620279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75050-720e-4838-bcc8-0ee1b43b8da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:50.621783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75050-720e-4838-bcc8-0ee1b43b8da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:50.622545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75050-720e-4838-bcc8-0ee1b43b8da5 admin admin] PATH_INFO: `/v3/projects/ba1b072775974eed8c56ea91bb5ee959/users/820a5287bc114deeae6457c5daa63514/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:50.733449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75050-720e-4838-bcc8-0ee1b43b8da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1b072775974eed8c56ea91bb5ee959, user_id=820a5287bc114deeae6457c5daa63514, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:50.741567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75050-720e-4838-bcc8-0ee1b43b8da5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:50.798764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 900/1793] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:50 2022] PUT /identity/v3/projects/ba1b072775974eed8c56ea91bb5ee959/users/820a5287bc114deeae6457c5daa63514/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:50.807873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996814c1-816a-402d-94bf-7213368ac5cc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:50.811778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e82fc-bb5b-4afa-8db4-58a914fdb7d2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:50.813004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e82fc-bb5b-4afa-8db4-58a914fdb7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:50.816321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e82fc-bb5b-4afa-8db4-58a914fdb7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:50.945544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-744e82fc-bb5b-4afa-8db4-58a914fdb7d2 None None] MFA Rules not processed for user `cb3146ed5b1947ee99cba2e95a777a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:50.955507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-744e82fc-bb5b-4afa-8db4-58a914fdb7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:50.958959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:51.045522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:51.046360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:51.046860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:51.047147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:51.048003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:51.051927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:51.099352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 894/1794] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:50 2022] POST /identity/v3/users => generated 285 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:51.102673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:51.109001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:51.146964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d93df-8cc1-42da-a588-e87159a7ab9f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:51.165418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:51.168638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:51.168970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:51.169298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] PATH_INFO: `/v3/projects/71100adccb244c7b93cf52873f64032a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:51.176467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71100adccb244c7b93cf52873f64032a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:51.184790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:51.344654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71100adccb244c7b93cf52873f64032a', 'request_id': 'req-5f199ff3-da49-4510-b6a4-fe79496f568a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:51.369857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71100adccb244c7b93cf52873f64032a', 'request_id': 'req-5f199ff3-da49-4510-b6a4-fe79496f568a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:51.386791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 901/1795] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:51.387474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71100adccb244c7b93cf52873f64032a', 'request_id': 'req-5f199ff3-da49-4510-b6a4-fe79496f568a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:51.398627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9a4b-d92d-4390-8b81-fc1486db3ca9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:51.398945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9a4b-d92d-4390-8b81-fc1486db3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:51.407307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9a4b-d92d-4390-8b81-fc1486db3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:51.442036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] The token cache is being invalidate because project 71100adccb244c7b93cf52873f64032a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:13:51.442369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:51.446248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:51.454142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 895/1796] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:13:51 2022] DELETE /identity/v3/projects/71100adccb244c7b93cf52873f64032a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:51.454142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:51.456083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:51.537708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:51.596804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f29a9a4b-d92d-4390-8b81-fc1486db3ca9 None None] MFA Rules not processed for user `820a5287bc114deeae6457c5daa63514`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:51.601807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f29a9a4b-d92d-4390-8b81-fc1486db3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:51.719408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199ff3-da49-4510-b6a4-fe79496f568a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:51.734332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec74b9-57d7-43bf-909e-47e4f238bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:51.739539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec74b9-57d7-43bf-909e-47e4f238bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:51.740662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec74b9-57d7-43bf-909e-47e4f238bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:51.740937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec74b9-57d7-43bf-909e-47e4f238bba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:51.741751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec74b9-57d7-43bf-909e-47e4f238bba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:51.743621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec74b9-57d7-43bf-909e-47e4f238bba0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:51.800566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 896/1797] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:51.808165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:51.808165 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:51.808426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:51.882295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:51.894150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:51.934190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 902/1798] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:51.936140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4a9c-1514-430f-a5ab-da4364b73080 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:51.936490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4a9c-1514-430f-a5ab-da4364b73080 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:51.936777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4a9c-1514-430f-a5ab-da4364b73080 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:51.938424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 903/1799] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:51.944209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4a9c-1514-430f-a5ab-da4364b73080 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:51.955981 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 897/1800] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:51.960839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:51.966588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:51.982959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4a9c-1514-430f-a5ab-da4364b73080 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:51.994712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:51.995678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:51.996368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:51.996659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] PATH_INFO: `/v3/projects/d3b88ad8f26448e78ba29c2c81f22c39/users/68f909dfd75d441686e92bc6a87c3296/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.045608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b88ad8f26448e78ba29c2c81f22c39, user_id=68f909dfd75d441686e92bc6a87c3296, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:52.050526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:52.079168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 904/1801] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:51 2022] PUT /identity/v3/projects/d3b88ad8f26448e78ba29c2c81f22c39/users/68f909dfd75d441686e92bc6a87c3296/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:52.080103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:52.092094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:52.109389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:52.173257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe8a63-3cd6-4320-8797-168b88ad7017 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:52.328745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb317fe-b052-4071-ada0-f0297cb2a245 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:52.352649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543fa51-a99d-46a0-9266-83d21d864010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:52.354094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543fa51-a99d-46a0-9266-83d21d864010 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:52.354678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543fa51-a99d-46a0-9266-83d21d864010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:52.354792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:52.355153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543fa51-a99d-46a0-9266-83d21d864010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.356007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543fa51-a99d-46a0-9266-83d21d864010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:52.357506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:52.357820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:52.359222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.364688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:52.365595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543fa51-a99d-46a0-9266-83d21d864010 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:52.427793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 905/1802] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:52 2022] POST /identity/v3/projects => generated 363 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:52.429467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113dc20-6545-40da-9886-8d62d83dc547 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:52.429853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113dc20-6545-40da-9886-8d62d83dc547 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:52.430335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113dc20-6545-40da-9886-8d62d83dc547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.488568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9113dc20-6545-40da-9886-8d62d83dc547 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:52.497102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9113dc20-6545-40da-9886-8d62d83dc547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:52.585571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:52.591571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:52.629136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 898/1803] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:52.632878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:52.633951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:52.653944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 906/1804] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:52.655320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17da4-3658-4917-a02e-daf42fd3fb52 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:52.655721 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17da4-3658-4917-a02e-daf42fd3fb52 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:52.657939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17da4-3658-4917-a02e-daf42fd3fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.699426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae1b8-4f52-4291-9dd8-08a343f2a190 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:52.711639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-52d17da4-3658-4917-a02e-daf42fd3fb52 None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:52.713099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52d17da4-3658-4917-a02e-daf42fd3fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:52.728563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:52.733124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:52.733427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:52.733709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.734530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:52.749594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:52.803942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 899/1805] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:52.810291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:52.842837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e2048-b77f-4197-bf66-eaef03268e7d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:52.860173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:52.861166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:52.861622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:52.862068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.862950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:52.868581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:52.916476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 900/1806] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:52 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:52.918713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:52.935175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f80d6-eeeb-48b7-aedf-ebd3efd412ec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:52.935872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 907/1807] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:52.937954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d17da4-3658-4917-a02e-daf42fd3fb52 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:52.943578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:52.944615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:52.945274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:52.945990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:52.948263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:13:52.951870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:52.954457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:52.975925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d17da4-3658-4917-a02e-daf42fd3fb52 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:52.979987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 901/1808] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:13:52.983175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:53.027097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f10db7-a418-4f8a-a0a5-ae785092a0bb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:53.029877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:53.031047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:53.031502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:53.031912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] PATH_INFO: `/v3/projects/d3b88ad8f26448e78ba29c2c81f22c39/users/68f909dfd75d441686e92bc6a87c3296/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:53.037641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b88ad8f26448e78ba29c2c81f22c39, user_id=68f909dfd75d441686e92bc6a87c3296, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:53.044522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:53.056043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff3b16-51aa-46aa-9cde-4a79a7e17d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:53.057286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3b16-51aa-46aa-9cde-4a79a7e17d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:53.057571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3b16-51aa-46aa-9cde-4a79a7e17d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:53.057854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3b16-51aa-46aa-9cde-4a79a7e17d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:53.058764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff3b16-51aa-46aa-9cde-4a79a7e17d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:53.060635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff3b16-51aa-46aa-9cde-4a79a7e17d48 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:53.087166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 908/1809] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:52 2022] PUT /identity/v3/projects/d3b88ad8f26448e78ba29c2c81f22c39/users/68f909dfd75d441686e92bc6a87c3296/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:53.088341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:53.113078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 902/1810] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:53.114769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8e518-4b64-4864-b0d8-0b7f181227ee None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:53.125929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8e518-4b64-4864-b0d8-0b7f181227ee None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:53.126214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8e518-4b64-4864-b0d8-0b7f181227ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:53.233001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b9f8e518-4b64-4864-b0d8-0b7f181227ee None None] MFA Rules not processed for user `68f909dfd75d441686e92bc6a87c3296`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:53.240588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b9f8e518-4b64-4864-b0d8-0b7f181227ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:53.345842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68205038-22d4-44e0-973c-23f4c9e6e41c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:53.364278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:53.365084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:53.365483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:53.365871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:53.366746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:53.368919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:53.395821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:53.466077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 909/1811] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:53.477452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:53.543541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 903/1812] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:53 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:53.543541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8e518-4b64-4864-b0d8-0b7f181227ee None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:53.586239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8e518-4b64-4864-b0d8-0b7f181227ee None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:53.770875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b61a05-cf41-460f-ad86-25ed45e90aec admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:53.776639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:53.777975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:53.778467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:53.778891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] PATH_INFO: `/v3/projects/56eeeb9f4e17423f9ca639101895023f/users/b5f7abc3dc364105ac3ce25de4382f1a/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:53.792716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:53.795913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:53.796623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:53.796909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:53.798198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:53.800679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:53.804563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:53.808463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56eeeb9f4e17423f9ca639101895023f, user_id=b5f7abc3dc364105ac3ce25de4382f1a, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:53.814974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:53.859359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 910/1813] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:53 2022] PUT /identity/v3/projects/56eeeb9f4e17423f9ca639101895023f/users/b5f7abc3dc364105ac3ce25de4382f1a/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:53.861966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:53.870048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:53.871682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 904/1814] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:53 2022] POST /identity/v3/users => generated 292 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:53.873748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:53.903247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ade75-0d07-4b77-a618-ee8aca452346 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:54.177956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bb553-3abc-4b58-bd5d-2eee58cb2b4b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:54.205993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:54.210713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:54.211020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:54.211305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:54.240044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:54.240855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:54.241205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:54.241491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:54.242363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:54.254770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:54.305554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 905/1815] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:54.307188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:54.371518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c57861-c343-4ee0-9c6e-7699f063098c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:54.396615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:54.400929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:54.401299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:54.401607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:54.411282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:54.420839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:54.492202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 906/1816] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:54.499222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:54.563528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55615c2-76d8-4361-9679-4b0add5c808c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:54.589898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:54.591499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:54.594589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4051d8-ac1b-444c-8796-a288cc61d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:54.596554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4051d8-ac1b-444c-8796-a288cc61d49c admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:54.599222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4051d8-ac1b-444c-8796-a288cc61d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:54.600609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4051d8-ac1b-444c-8796-a288cc61d49c admin admin] PATH_INFO: `/v3/projects/56eeeb9f4e17423f9ca639101895023f/users/b5f7abc3dc364105ac3ce25de4382f1a/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:54.617645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4051d8-ac1b-444c-8796-a288cc61d49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56eeeb9f4e17423f9ca639101895023f, user_id=b5f7abc3dc364105ac3ce25de4382f1a, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:54.630542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4051d8-ac1b-444c-8796-a288cc61d49c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:54.649820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 911/1817] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:53 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:54.658749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:54.685524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 907/1818] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:54 2022] PUT /identity/v3/projects/56eeeb9f4e17423f9ca639101895023f/users/b5f7abc3dc364105ac3ce25de4382f1a/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:54.700282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f9bd-2852-4c8f-9b0e-16e6fae264f8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:54.700615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f9bd-2852-4c8f-9b0e-16e6fae264f8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:54.700980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f9bd-2852-4c8f-9b0e-16e6fae264f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:54.728741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f25f4c-0a07-4f1f-b72f-dbbf0264c2ad service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:54.825506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-def5f9bd-2852-4c8f-9b0e-16e6fae264f8 None None] MFA Rules not processed for user `b5f7abc3dc364105ac3ce25de4382f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:54.831964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-def5f9bd-2852-4c8f-9b0e-16e6fae264f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:54.953721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:55.016414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:55.017173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:55.023357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:55.024281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:55.028224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:55.033707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:55.078925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 912/1819] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:55.080245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:55.087373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:55.160158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 908/1820] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:13:55.163017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f9bd-2852-4c8f-9b0e-16e6fae264f8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:55.321299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:55.395772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f9bd-2852-4c8f-9b0e-16e6fae264f8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:55.412857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50905563-9ff1-4bf1-b541-962691a5d901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:55.413590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905563-9ff1-4bf1-b541-962691a5d901 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:55.413879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905563-9ff1-4bf1-b541-962691a5d901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:55.420020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905563-9ff1-4bf1-b541-962691a5d901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:55.437393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-50905563-9ff1-4bf1-b541-962691a5d901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:55.617863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bd24b-ab8a-435e-a9e4-3d90490f91b8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:55.639643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:55.641769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:55.641769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:55.641769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:55.682285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:55.684006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:55.742950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 913/1821] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:55.743903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:55.747126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50905563-9ff1-4bf1-b541-962691a5d901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:55.748603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50905563-9ff1-4bf1-b541-962691a5d901 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:55.780009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755091f2-66f3-4a1b-b2e8-e6bd8a41d649 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:55.787814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 909/1822] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:55 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:55.789262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b160-6c17-4f0e-a143-9a781e16d7b7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:55.789552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b160-6c17-4f0e-a143-9a781e16d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:55.789830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b160-6c17-4f0e-a143-9a781e16d7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:55.808574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:55.809616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:55.809893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:55.810194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] PATH_INFO: `/v3/projects/5ff8f6ce20ff450e90af1118598ba81e/users/3b9da0ef95ed4666add7954cabc0a894/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:55.858311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6423b160-6c17-4f0e-a143-9a781e16d7b7 None None] MFA Rules not processed for user `b3e73f3002da4da3b94cb17f837defb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:55.858311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6423b160-6c17-4f0e-a143-9a781e16d7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:55.870735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff8f6ce20ff450e90af1118598ba81e, user_id=3b9da0ef95ed4666add7954cabc0a894, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:55.874128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:55.920068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 914/1823] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:55 2022] PUT /identity/v3/projects/5ff8f6ce20ff450e90af1118598ba81e/users/3b9da0ef95ed4666add7954cabc0a894/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:55.920068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:56.075584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 910/1824] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:56.077214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e462f1-0e8f-4a94-ae33-914576db96cb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:56.085330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e462f1-0e8f-4a94-ae33-914576db96cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:56.086399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e462f1-0e8f-4a94-ae33-914576db96cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:56.145742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21067d-e11f-41d9-ac57-fe1113f8c274 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:56.166364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a4e462f1-0e8f-4a94-ae33-914576db96cb None None] MFA Rules not processed for user `3b9da0ef95ed4666add7954cabc0a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:56.167081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf55475-38c8-4710-ade5-a5c1d3c4c0a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:56.168067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55475-38c8-4710-ade5-a5c1d3c4c0a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:56.168189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55475-38c8-4710-ade5-a5c1d3c4c0a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:56.168502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55475-38c8-4710-ade5-a5c1d3c4c0a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:56.169725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a4e462f1-0e8f-4a94-ae33-914576db96cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:56.222712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:56.342423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf55475-38c8-4710-ade5-a5c1d3c4c0a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:56.346873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf55475-38c8-4710-ade5-a5c1d3c4c0a9 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:56.390636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 915/1825] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:56.392214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea671a-0eb1-436a-9296-2af8da0d1379 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:56.392511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea671a-0eb1-436a-9296-2af8da0d1379 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:56.392816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea671a-0eb1-436a-9296-2af8da0d1379 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:56.394686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 916/1826] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:13:56.549027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 911/1827] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:56.550578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea671a-0eb1-436a-9296-2af8da0d1379 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:56.624800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ee499-d16f-4017-a1a9-fbe45bf834bf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:56.626915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ee499-d16f-4017-a1a9-fbe45bf834bf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:56.627405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ee499-d16f-4017-a1a9-fbe45bf834bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:56.670413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:56.698993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-338ee499-d16f-4017-a1a9-fbe45bf834bf None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:56.703256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-338ee499-d16f-4017-a1a9-fbe45bf834bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:56.741029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea671a-0eb1-436a-9296-2af8da0d1379 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:56.760320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:56.764983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:56.765301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:56.765594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:56.767874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:56.770831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:56.907758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 917/1828] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:13:56 2022] POST /identity/v3/projects => generated 383 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:56.908786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:57.039789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 912/1829] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:57.041389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ee499-d16f-4017-a1a9-fbe45bf834bf None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:57.089221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ee499-d16f-4017-a1a9-fbe45bf834bf None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:57.210738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a31b-747b-4ea8-91f8-e177ca72bd1d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:57.235535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:57.236298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:57.243515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:57.247587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:57.261954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:57.263055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:57.263441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:57.263814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:57.269189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:57.280509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:57.339740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 913/1830] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:13:57 2022] POST /identity/v3/users => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:13:57.347103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:57.379796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534127-071e-4d6c-b551-d9b0af353006 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:57.404645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:57.407669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:57.409007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:57.409744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:57.416811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:57.424057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:57.461920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 914/1831] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:57.463094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:57.523060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34843403-93eb-4bde-aae5-59d2e0a98beb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:57.546466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:57.547617 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:57.547971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:57.549422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] PATH_INFO: `/v3/projects/d02001c597df434fb54b9c232e42e0fe/users/7fcfacba50754d2cbb36413b221be27e/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:57.552632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:57.553642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:57.588414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02001c597df434fb54b9c232e42e0fe, user_id=7fcfacba50754d2cbb36413b221be27e, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:57.594838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:57.608528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 918/1832] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:57.610231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:57.641170 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 915/1833] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:57 2022] PUT /identity/v3/projects/d02001c597df434fb54b9c232e42e0fe/users/7fcfacba50754d2cbb36413b221be27e/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:57.642688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:57.656954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0ef4-4eba-4a92-822c-f9d019dd60a6 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:57.765449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:57.773556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:57.773556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:57.773556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:57.773556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:57.773556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:57.792783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 919/1834] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:13:57.794708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:57.810698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae91db2-47b1-4233-95aa-6e3f8835c895 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:57.817245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8df3d-ae70-4757-8c40-4b85f9829e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:57.818586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8df3d-ae70-4757-8c40-4b85f9829e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:57.819059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8df3d-ae70-4757-8c40-4b85f9829e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:57.819494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8df3d-ae70-4757-8c40-4b85f9829e8a admin admin] PATH_INFO: `/v3/projects/d02001c597df434fb54b9c232e42e0fe/users/7fcfacba50754d2cbb36413b221be27e/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:57.859044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8df3d-ae70-4757-8c40-4b85f9829e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02001c597df434fb54b9c232e42e0fe, user_id=7fcfacba50754d2cbb36413b221be27e, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:57.886443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8df3d-ae70-4757-8c40-4b85f9829e8a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:57.962305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:57.968270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 916/1835] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:13:57 2022] PUT /identity/v3/projects/d02001c597df434fb54b9c232e42e0fe/users/7fcfacba50754d2cbb36413b221be27e/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:13:57.986304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6620-5394-4030-9ead-3cd4ed9c3899 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:57.986679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6620-5394-4030-9ead-3cd4ed9c3899 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:57.986957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6620-5394-4030-9ead-3cd4ed9c3899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:58.042081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:58.061855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-99cd6620-5394-4030-9ead-3cd4ed9c3899 None None] MFA Rules not processed for user `7fcfacba50754d2cbb36413b221be27e`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:13:58.064580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-99cd6620-5394-4030-9ead-3cd4ed9c3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:13:58.227727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19bcb-0017-4a34-8aa2-7ad0063a40fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:58.328408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 917/1836] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:13:58.339746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6620-5394-4030-9ead-3cd4ed9c3899 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:58.489548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:58.490268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:58.490576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:58.490862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:58.508032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6620-5394-4030-9ead-3cd4ed9c3899 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:58.524602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:58.525934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:58.526503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:58.527066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:58.543361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:58.547151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:58.579653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:58.582918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:58.621431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 920/1837] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:58.626861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 918/1838] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:13:58.794131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:58.824277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097823-df16-4922-96cb-b1111abc0b2d service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:58.829132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533760b-a38d-41e6-93de-887628343fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:58.829845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533760b-a38d-41e6-93de-887628343fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:58.830203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533760b-a38d-41e6-93de-887628343fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:58.830577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533760b-a38d-41e6-93de-887628343fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:58.978433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533760b-a38d-41e6-93de-887628343fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:58.984621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533760b-a38d-41e6-93de-887628343fe9 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:59.003414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 921/1839] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:13:59.735494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:13:59.827023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a83d9-f06a-4e48-a6aa-64491b4807e2 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:13:59.845604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:13:59.846527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:13:59.846755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:13:59.847136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] PATH_INFO: `/v3/users/3b9da0ef95ed4666add7954cabc0a894` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:13:59.848987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9da0ef95ed4666add7954cabc0a894)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:13:59.851715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:13:59.889153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:13:59.960067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9da0ef95ed4666add7954cabc0a894'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:59.960739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9da0ef95ed4666add7954cabc0a894'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:59.974421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9da0ef95ed4666add7954cabc0a894'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:59.975657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9da0ef95ed4666add7954cabc0a894'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:13:59.988599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9da0ef95ed4666add7954cabc0a894'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:00.025719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 919/1840] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:13:59 2022] DELETE /identity/v3/users/3b9da0ef95ed4666add7954cabc0a894 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:00.030367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:00.031766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:00.032112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:00.057848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:00.062488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:00.131944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:00.176683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 922/1841] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:14:00.187008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:00.188792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:00.294251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285ea5-dd2a-4bfa-a65b-bf0beac28e15 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:00.298510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:00.299516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:00.299865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:00.300216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:00.310968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:00.312678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:00.324856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 920/1842] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:14:00.584788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:00.586691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:00.616096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4848ef9-f6bc-4faa-9fa9-f2e5d7e85296 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:00.622247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:00.623802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:00.624279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:00.624397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] PATH_INFO: `/v3/users/0dea7d660f1f4ff8919c527d7b7f0927` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:00.626042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dea7d660f1f4ff8919c527d7b7f0927)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:00.628153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:00.703493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dea7d660f1f4ff8919c527d7b7f0927'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:00.732378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dea7d660f1f4ff8919c527d7b7f0927'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:00.751741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dea7d660f1f4ff8919c527d7b7f0927'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:00.752597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:00.757624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:00.763711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dea7d660f1f4ff8919c527d7b7f0927'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:00.765019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d7fd2276-b594-485e-bbef-23760d7daa43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dea7d660f1f4ff8919c527d7b7f0927'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:00.772686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 923/1843] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:00 2022] DELETE /identity/v3/users/0dea7d660f1f4ff8919c527d7b7f0927 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:00.779984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:00.779984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:00.780244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:00.796873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa954898-ab41-4322-bb26-efd9141dddba service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:00.812730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:00.814361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:00.908519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 924/1844] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:00.914663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:00.915605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:00.915950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:00.916186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] PATH_INFO: `/v3/projects/5ff8f6ce20ff450e90af1118598ba81e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:00.917759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff8f6ce20ff450e90af1118598ba81e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:00.919424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:00.921294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:00.921539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:00.983797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:01.003106 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2de6e0-2950-481e-88f6-002b3e99e303 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:01.007470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff8f6ce20ff450e90af1118598ba81e', 'request_id': 'req-4849114e-c953-45d8-9078-a283f44bf1f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.012455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:01.021725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff8f6ce20ff450e90af1118598ba81e', 'request_id': 'req-4849114e-c953-45d8-9078-a283f44bf1f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.038534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff8f6ce20ff450e90af1118598ba81e', 'request_id': 'req-4849114e-c953-45d8-9078-a283f44bf1f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.058841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] The token cache is being invalidate because project 5ff8f6ce20ff450e90af1118598ba81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:01.059138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.060466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.062289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 921/1845] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:00 2022] DELETE /identity/v3/projects/5ff8f6ce20ff450e90af1118598ba81e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:01.066509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:01.068148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:01.084851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:01.086035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:01.086035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:01.086035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:01.089127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:01.151988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849114e-c953-45d8-9078-a283f44bf1f5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:01.160914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:01.161908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:01.164366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:01.164366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] PATH_INFO: `/v3/users/7fcfacba50754d2cbb36413b221be27e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:01.164366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcfacba50754d2cbb36413b221be27e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:01.166300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:01.182289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:01.184513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:01.204300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 925/1846] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:14:01.244526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcfacba50754d2cbb36413b221be27e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.245881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcfacba50754d2cbb36413b221be27e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.257587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcfacba50754d2cbb36413b221be27e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.258546 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcfacba50754d2cbb36413b221be27e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.268660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fbff412-fb3c-41eb-ac7e-ee6e79722061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcfacba50754d2cbb36413b221be27e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.290276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 922/1847] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:01 2022] DELETE /identity/v3/users/7fcfacba50754d2cbb36413b221be27e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:14:01.335664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:01.338743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:01.360964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294e4a2-c282-4685-a1c7-7168cf26890c service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:01.450914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:01.451840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:01.452131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:01.452416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] PATH_INFO: `/v3/users/820a5287bc114deeae6457c5daa63514` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:01.453779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820a5287bc114deeae6457c5daa63514)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:01.455815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:01.599471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820a5287bc114deeae6457c5daa63514'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.617383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:01.622696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820a5287bc114deeae6457c5daa63514'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.634103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820a5287bc114deeae6457c5daa63514'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.643385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820a5287bc114deeae6457c5daa63514'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.644066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820a5287bc114deeae6457c5daa63514'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:01.653674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 926/1848] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:01 2022] DELETE /identity/v3/users/820a5287bc114deeae6457c5daa63514 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:01.658583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:01.658873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:01.659141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:01.680352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:01.681711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:01.770449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:01.809010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 923/1849] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:01.851708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:01.854861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:01.874454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:01.875939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:01.901138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04db4-a2fb-40b7-84a5-4bfa54dd5ce4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:01.917383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:01.918368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:01.918657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:01.918954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] PATH_INFO: `/v3/projects/03881e0e1e9e48a886c161f3247dc7ff` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:01.920930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] RBAC: Authorizing `identity:delete_project(project_id=03881e0e1e9e48a886c161f3247dc7ff)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:01.923017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:01.993642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65288b4c-f14c-4fc1-829f-b03437128899 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.001019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.002469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.003085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.003710 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.016104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03881e0e1e9e48a886c161f3247dc7ff', 'request_id': 'req-6adc3f4b-1ffb-44bd-904f-da2054c4108b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.022885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.026062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03881e0e1e9e48a886c161f3247dc7ff', 'request_id': 'req-6adc3f4b-1ffb-44bd-904f-da2054c4108b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.027778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.033256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03881e0e1e9e48a886c161f3247dc7ff', 'request_id': 'req-6adc3f4b-1ffb-44bd-904f-da2054c4108b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.048017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] The token cache is being invalidate because project 03881e0e1e9e48a886c161f3247dc7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:02.048459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.049550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.052066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 927/1850] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:02.052195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 924/1851] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:01 2022] DELETE /identity/v3/projects/03881e0e1e9e48a886c161f3247dc7ff => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:02.055201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.065421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b46ca-3971-46f3-b230-80b135521a1e service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.142473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.144627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.145105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.145791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] PATH_INFO: `/v3/users/e4c5d47ae7a94c009d2ab8f8885944ff` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.147705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c5d47ae7a94c009d2ab8f8885944ff)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.149073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.151411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:02.152257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.168079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3f4b-1ffb-44bd-904f-da2054c4108b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.203688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.205110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.205110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.205348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] PATH_INFO: `/v3/projects/d02001c597df434fb54b9c232e42e0fe` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.208645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02001c597df434fb54b9c232e42e0fe)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.210671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.248705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c5d47ae7a94c009d2ab8f8885944ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.283730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c5d47ae7a94c009d2ab8f8885944ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.295310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02001c597df434fb54b9c232e42e0fe', 'request_id': 'req-d232cc8b-131e-455c-9cae-6fe5c3c7f423'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.304687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c5d47ae7a94c009d2ab8f8885944ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.316319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02001c597df434fb54b9c232e42e0fe', 'request_id': 'req-d232cc8b-131e-455c-9cae-6fe5c3c7f423'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.325926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c5d47ae7a94c009d2ab8f8885944ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.327235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-03375e5f-7a4c-4e94-9c66-e2b280d97e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c5d47ae7a94c009d2ab8f8885944ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.331810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02001c597df434fb54b9c232e42e0fe', 'request_id': 'req-d232cc8b-131e-455c-9cae-6fe5c3c7f423'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.346755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 928/1852] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:02 2022] DELETE /identity/v3/users/e4c5d47ae7a94c009d2ab8f8885944ff => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:02.354000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] The token cache is being invalidate because project d02001c597df434fb54b9c232e42e0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:02.354451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.355241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.360182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 925/1853] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:02 2022] DELETE /identity/v3/projects/d02001c597df434fb54b9c232e42e0fe => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:14:02.361825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7241-806b-42fe-aa35-be6daedb0a1b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.362121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7241-806b-42fe-aa35-be6daedb0a1b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.362451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7241-806b-42fe-aa35-be6daedb0a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.369808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:02.385566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-888f7241-806b-42fe-aa35-be6daedb0a1b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:02.386951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-888f7241-806b-42fe-aa35-be6daedb0a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:02.494077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 929/1854] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:02.502568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698465-052f-4294-8550-bdb6b6c9f1db None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.502974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698465-052f-4294-8550-bdb6b6c9f1db None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.503421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698465-052f-4294-8550-bdb6b6c9f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.503705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.506919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:02.553829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-65698465-052f-4294-8550-bdb6b6c9f1db None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:02.556967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-65698465-052f-4294-8550-bdb6b6c9f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:02.566005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 930/1855] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:02.570556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65698465-052f-4294-8550-bdb6b6c9f1db None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.586441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:02.589612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65698465-052f-4294-8550-bdb6b6c9f1db None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.598531 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.600193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.600683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.602127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.603336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:14:02.604119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.608210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.612952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232cc8b-131e-455c-9cae-6fe5c3c7f423 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.617327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.618289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.619113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.619522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] PATH_INFO: `/v3/projects/ba1b072775974eed8c56ea91bb5ee959` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.621406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1b072775974eed8c56ea91bb5ee959)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.623619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.639223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 931/1856] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:14:02.641582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.659447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751736-b2aa-4e44-aa51-1eab519c6c51 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.666456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.667141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.668138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.668138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.668731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.670847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.714059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1b072775974eed8c56ea91bb5ee959', 'request_id': 'req-bd370028-d03f-4d27-bc36-855684173c34'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.719817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 932/1857] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:02 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:02.720803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.731932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1b072775974eed8c56ea91bb5ee959', 'request_id': 'req-bd370028-d03f-4d27-bc36-855684173c34'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.739875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1b072775974eed8c56ea91bb5ee959', 'request_id': 'req-bd370028-d03f-4d27-bc36-855684173c34'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.764602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] The token cache is being invalidate because project ba1b072775974eed8c56ea91bb5ee959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:02.766182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.768247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.771386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 926/1858] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:02 2022] DELETE /identity/v3/projects/ba1b072775974eed8c56ea91bb5ee959 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:14:02.798771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.800937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:02.854135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba97c-4e87-42ef-8599-7bd686172b90 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.863797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.864507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.864793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.865074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.866335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.868315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.899760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 933/1859] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:02 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:02.899760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:02.903103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:02.914877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd370028-d03f-4d27-bc36-855684173c34 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.917544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81728fe-97d6-4ded-9fee-78d9e408aaba admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:02.920887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.921781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.922066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.922375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] PATH_INFO: `/v3/users/b5f7abc3dc364105ac3ce25de4382f1a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.923643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f7abc3dc364105ac3ce25de4382f1a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.925575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.934832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:02.936511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:02.937057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:02.937415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] PATH_INFO: `/v3/projects/f31615cb458d4569b2c34fe4b6dae54b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:02.943132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31615cb458d4569b2c34fe4b6dae54b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:02.945895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:02.975828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f7abc3dc364105ac3ce25de4382f1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.976793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f7abc3dc364105ac3ce25de4382f1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.984990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f7abc3dc364105ac3ce25de4382f1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.985698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f7abc3dc364105ac3ce25de4382f1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.993327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f7abc3dc364105ac3ce25de4382f1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:02.995193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:02.998421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31615cb458d4569b2c34fe4b6dae54b', 'request_id': 'req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.006299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31615cb458d4569b2c34fe4b6dae54b', 'request_id': 'req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.007887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:03.013248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31615cb458d4569b2c34fe4b6dae54b', 'request_id': 'req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.014127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 927/1860] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:02 2022] DELETE /identity/v3/users/b5f7abc3dc364105ac3ce25de4382f1a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:03.017306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.017306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.030883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] The token cache is being invalidate because project f31615cb458d4569b2c34fe4b6dae54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:03.031195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.032071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d3bf9bc-72fc-454b-8efd-b3b5ad0571e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.034065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 934/1861] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:02 2022] DELETE /identity/v3/projects/f31615cb458d4569b2c34fe4b6dae54b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:03.039956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234603bf-4fc1-4eed-a5d6-6f78d152f678 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.040900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234603bf-4fc1-4eed-a5d6-6f78d152f678 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.041187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234603bf-4fc1-4eed-a5d6-6f78d152f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.062818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-234603bf-4fc1-4eed-a5d6-6f78d152f678 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:03.064040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-234603bf-4fc1-4eed-a5d6-6f78d152f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.093965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185f0c5-531f-42b5-beed-32f6d1fe7151 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.100632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.101576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.101897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.102331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.103600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.105232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.120837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 928/1862] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:03.125166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.127113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.144772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 935/1863] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:14:03.145322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965b58b-8c46-411a-b1c7-d5fa0cb12ef5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.147212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44333b5-d478-409e-99b1-5eea83809ca5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.147508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44333b5-d478-409e-99b1-5eea83809ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.148031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44333b5-d478-409e-99b1-5eea83809ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.148816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.150603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.150987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.151367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.152206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.153885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.170679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 929/1864] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:14:03.170679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.172327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d44333b5-d478-409e-99b1-5eea83809ca5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:03.173561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d44333b5-d478-409e-99b1-5eea83809ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.179548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eb165-04c5-4ca4-906e-992d5b699b02 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.183768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 936/1865] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:03.187699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44333b5-d478-409e-99b1-5eea83809ca5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.188830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.189749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.190036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.190407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] PATH_INFO: `/v3/projects/8900dece4ef643d1a3556feb3a2738fd/users/5e19b50cb4e14b978f9786ab92b116ab/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.198074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44333b5-d478-409e-99b1-5eea83809ca5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.206949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2522f-3058-4c01-a4c2-7be4c6beb962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.207890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2522f-3058-4c01-a4c2-7be4c6beb962 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.208188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2522f-3058-4c01-a4c2-7be4c6beb962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.208753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2522f-3058-4c01-a4c2-7be4c6beb962 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.209468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2522f-3058-4c01-a4c2-7be4c6beb962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:14:03.209593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8900dece4ef643d1a3556feb3a2738fd, user_id=5e19b50cb4e14b978f9786ab92b116ab, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.209782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2522f-3058-4c01-a4c2-7be4c6beb962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.212029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2522f-3058-4c01-a4c2-7be4c6beb962 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.213692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.230246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 930/1866] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:03 2022] PUT /identity/v3/projects/8900dece4ef643d1a3556feb3a2738fd/users/5e19b50cb4e14b978f9786ab92b116ab/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:14:03.232054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 937/1867] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:14:03.233073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.236125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.236690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.237094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.258124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:03.259924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.315896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf76f-4e02-4b42-81c0-94e741293f5d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.321298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.322615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.322973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.323278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.324172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.326274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.362958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 938/1868] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:14:03.364312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.367845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 931/1869] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:03.369938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.373434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.391062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5932-17df-4fbe-824b-256b3aacb992 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.422523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:03.449961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9a38-e17c-4e47-a90d-44c406b0f003 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.457892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.458945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.459406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.459874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.461074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.464400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.467457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:03.481739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.483805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.484492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.485129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] PATH_INFO: `/v3/projects/56eeeb9f4e17423f9ca639101895023f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.488005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56eeeb9f4e17423f9ca639101895023f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.496994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.514492 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 932/1870] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:03.515601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.517597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.590253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56eeeb9f4e17423f9ca639101895023f', 'request_id': 'req-ea90971f-5108-4990-860b-09411c80641a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.597498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56eeeb9f4e17423f9ca639101895023f', 'request_id': 'req-ea90971f-5108-4990-860b-09411c80641a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.605359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56eeeb9f4e17423f9ca639101895023f', 'request_id': 'req-ea90971f-5108-4990-860b-09411c80641a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.627648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] The token cache is being invalidate because project 56eeeb9f4e17423f9ca639101895023f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:03.628188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.629076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:03.631474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 939/1871] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:03 2022] DELETE /identity/v3/projects/56eeeb9f4e17423f9ca639101895023f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:03.632564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.636982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed25d7e-bf9a-4986-9ec9-374cee8b9e3a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.637564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.731498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90971f-5108-4990-860b-09411c80641a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.737253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019495f-d1e3-4806-92ef-46a33bd88271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.737955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019495f-d1e3-4806-92ef-46a33bd88271 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.738272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019495f-d1e3-4806-92ef-46a33bd88271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.738736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.738880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019495f-d1e3-4806-92ef-46a33bd88271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.739437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.739551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019495f-d1e3-4806-92ef-46a33bd88271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.739724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.740002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.741253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019495f-d1e3-4806-92ef-46a33bd88271 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.742113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.753465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 940/1872] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:03.754909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9816-249c-45d8-8214-b7fa7a55988d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.755201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9816-249c-45d8-8214-b7fa7a55988d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.755514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9816-249c-45d8-8214-b7fa7a55988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.756784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.758528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.769283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 933/1873] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:03.770146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.779652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e5ec9816-249c-45d8-8214-b7fa7a55988d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:03.780106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5b1c4-a7f7-4ae9-a773-ebe734ba9d1d service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.780970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e5ec9816-249c-45d8-8214-b7fa7a55988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.787328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.788061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.788351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.788635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.789380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.791585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.796152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 941/1874] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:03.805883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 934/1875] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:03.807075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00e20-7347-464c-86d4-09e34148dc00 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.807385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00e20-7347-464c-86d4-09e34148dc00 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.807534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.807732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00e20-7347-464c-86d4-09e34148dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.819921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb99b9-dfd8-491d-952d-d596e22a4796 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.825235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831312f-c968-4205-964e-54463f219069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:03.826380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831312f-c968-4205-964e-54463f219069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.826738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831312f-c968-4205-964e-54463f219069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.827092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831312f-c968-4205-964e-54463f219069 admin admin] PATH_INFO: `/v3/projects/055c5e6a64be416ba2ccf835c1fba741/users/67975cf80cba4bcaa88034906e4e7d46/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.839592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c0a00e20-7347-464c-86d4-09e34148dc00 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:03.842897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c0a00e20-7347-464c-86d4-09e34148dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:03.847968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831312f-c968-4205-964e-54463f219069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055c5e6a64be416ba2ccf835c1fba741, user_id=67975cf80cba4bcaa88034906e4e7d46, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:03.851635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831312f-c968-4205-964e-54463f219069 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:03.858324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 942/1876] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:03.860351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00e20-7347-464c-86d4-09e34148dc00 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:03.876811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 935/1877] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:03 2022] PUT /identity/v3/projects/055c5e6a64be416ba2ccf835c1fba741/users/67975cf80cba4bcaa88034906e4e7d46/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:03.890246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00e20-7347-464c-86d4-09e34148dc00 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:03.893706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa496b-5a0c-4fa7-805f-10a732408002 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:03.894299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa496b-5a0c-4fa7-805f-10a732408002 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:03.894685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa496b-5a0c-4fa7-805f-10a732408002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:03.944315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2faa496b-5a0c-4fa7-805f-10a732408002 None None] MFA Rules not processed for user `67975cf80cba4bcaa88034906e4e7d46`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:03.945561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2faa496b-5a0c-4fa7-805f-10a732408002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:04.001128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.001982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.002311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.002596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.003370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:14:04.003848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.005577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.020643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 943/1878] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:14:04.024058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.030835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:04.032902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:04.042746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f56ab-f3ea-4178-9cbf-aa4156552b9c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.050621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.051282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.051563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.051838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.052609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.054731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.095391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 936/1880] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:04.095921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 944/1880] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:14:04.100126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa496b-5a0c-4fa7-805f-10a732408002 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.100634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.114376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa496b-5a0c-4fa7-805f-10a732408002 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.232091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.237632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b400492-7f93-4601-8484-0d9af4f91438 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.244771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.244975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.245496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.245787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.246084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.246451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.246884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.247713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.248841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.249776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.255961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.291640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 945/1881] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:14:04.299262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.304882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 937/1882] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:04.306025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.317962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e707b-da96-4907-889e-8d928163d014 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.397685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e301-02d6-422f-aa5e-00e4f9e42dd8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.401336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.402529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.402939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.403315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.404224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.406372 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.407036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.407959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.408249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.408527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.409660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.411618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.419495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 938/1883] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:04.423752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.437017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e93e-97a0-4025-8cf8-c52b7efd579e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.440818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 946/1884] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:04.444569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.445724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.446515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.447937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.447937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.448521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.450412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.457016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf150ce-5837-44a0-b2c4-1d8affc5b700 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.461487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 939/1885] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:14:04.463488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.464676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.464676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.464930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.465753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.466411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.467614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.480094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 947/1886] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:14:04.482226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa080e-0bc2-40bd-b053-351f47de3c97 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.485647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.487732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d2262-5e9a-4b81-93c4-2d1211f852ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.488661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2262-5e9a-4b81-93c4-2d1211f852ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.488928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2262-5e9a-4b81-93c4-2d1211f852ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.489241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2262-5e9a-4b81-93c4-2d1211f852ed admin admin] PATH_INFO: `/v3/projects/e48a527fb1f24a149bd0f4ef9d0a7208/users/57af4830196345489f468351fa780def/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.500725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702788-5642-41ca-a0d8-8f9de0c45f7d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.505775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.506859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.507206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.507561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] PATH_INFO: `/v3/projects/d0289419d0f84b7c9c94abe3f256c034/users/e45976f7fdde48e983a3d7bac6a89759/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.508511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d2262-5e9a-4b81-93c4-2d1211f852ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48a527fb1f24a149bd0f4ef9d0a7208, user_id=57af4830196345489f468351fa780def, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.513326 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d2262-5e9a-4b81-93c4-2d1211f852ed admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.530359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 940/1887] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:04 2022] PUT /identity/v3/projects/e48a527fb1f24a149bd0f4ef9d0a7208/users/57af4830196345489f468351fa780def/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:14:04.538155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0289419d0f84b7c9c94abe3f256c034, user_id=e45976f7fdde48e983a3d7bac6a89759, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.542651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c5b6b-3c74-4b6f-9b74-ad9d13b18afb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.543023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c5b6b-3c74-4b6f-9b74-ad9d13b18afb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.543394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c5b6b-3c74-4b6f-9b74-ad9d13b18afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.543976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.565861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 948/1888] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:04 2022] PUT /identity/v3/projects/d0289419d0f84b7c9c94abe3f256c034/users/e45976f7fdde48e983a3d7bac6a89759/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:04.567091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.579022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4b9c5b6b-3c74-4b6f-9b74-ad9d13b18afb None None] MFA Rules not processed for user `57af4830196345489f468351fa780def`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:04.581267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4b9c5b6b-3c74-4b6f-9b74-ad9d13b18afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:04.597523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:04.616171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:04.661054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb63cde-7507-4ed8-bdc8-f19c58fcd0bd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.667370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9cf8a-32b0-420f-a9e8-ea124f9f1b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.668180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cf8a-32b0-420f-a9e8-ea124f9f1b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.668472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cf8a-32b0-420f-a9e8-ea124f9f1b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.668853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cf8a-32b0-420f-a9e8-ea124f9f1b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.670470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9cf8a-32b0-420f-a9e8-ea124f9f1b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.672199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9cf8a-32b0-420f-a9e8-ea124f9f1b33 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.687176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 949/1889] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:04.688544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a64a-57c0-4621-b0ba-412de8f06dfe None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.688836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a64a-57c0-4621-b0ba-412de8f06dfe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.689115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a64a-57c0-4621-b0ba-412de8f06dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.692389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 941/1890] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:04.693836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c5b6b-3c74-4b6f-9b74-ad9d13b18afb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.714439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c5b6b-3c74-4b6f-9b74-ad9d13b18afb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.722493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cca0a64a-57c0-4621-b0ba-412de8f06dfe None None] MFA Rules not processed for user `5e19b50cb4e14b978f9786ab92b116ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:04.723130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.724298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cca0a64a-57c0-4621-b0ba-412de8f06dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:04.724686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.725182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.725673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] PATH_INFO: `/v3/projects/d0289419d0f84b7c9c94abe3f256c034/users/e45976f7fdde48e983a3d7bac6a89759/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.729894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0289419d0f84b7c9c94abe3f256c034, user_id=e45976f7fdde48e983a3d7bac6a89759, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.735168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.755888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 942/1891] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:04 2022] PUT /identity/v3/projects/d0289419d0f84b7c9c94abe3f256c034/users/e45976f7fdde48e983a3d7bac6a89759/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:04.757543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.815583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 950/1892] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:04.817104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564e779-9407-41a3-b385-ee9c1f2c264c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.818031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564e779-9407-41a3-b385-ee9c1f2c264c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.818352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564e779-9407-41a3-b385-ee9c1f2c264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.850579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048457d-4c29-45c0-a3ca-27bf0896c1c6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.857775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.859094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.859660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2564e779-9407-41a3-b385-ee9c1f2c264c None None] MFA Rules not processed for user `e45976f7fdde48e983a3d7bac6a89759`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:04.859830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.860245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.861292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2564e779-9407-41a3-b385-ee9c1f2c264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:04.861659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.863897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.895710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 943/1893] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:04.896457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.898272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:04.966257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 951/1894] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:04.967085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564e779-9407-41a3-b385-ee9c1f2c264c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:04.977927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564e779-9407-41a3-b385-ee9c1f2c264c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.988212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.988212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.988212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.988212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.988596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.988596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:04.988775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad78c-c2e4-484e-a95f-57290e5a6877 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:04.993333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:04.994069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:04.994524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:04.994807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:04.995500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:04.997382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.017029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 952/1895] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/users => generated 295 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:05.018831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.020398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:05.032093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 944/1896] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:04 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:05.033303 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.040154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:05.082825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:05.131476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af8851-cde6-4620-b823-342471c57bcd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.146667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc7c3c-a0cd-4611-9b4e-a5ae9839d4e6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.186322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.187103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.187379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.187660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.188427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.190096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.211400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 945/1897] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:05.211400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.229000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7124c-9c0b-4865-a779-b58fd0a81a3b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.234757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.235475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.235785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.236128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.252353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.252703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.252997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.253267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.253972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.255946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.288779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 946/1898] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:05 2022] POST /identity/v3/users => generated 293 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:05.290263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.304675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c50300-0b75-4d3d-910b-ef22211e872c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.312474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.314450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.314869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.315224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] PATH_INFO: `/v3/projects/17405fa6a217469eafc74c5965802d54/users/20e721e9e8134dffa80e0423eb398266/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.326004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.327655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.339961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17405fa6a217469eafc74c5965802d54, user_id=20e721e9e8134dffa80e0423eb398266, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.340568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 953/1899] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:05.341607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.343656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.356080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73732c3-2dd5-4557-9b10-0722b75be967 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.366246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 947/1900] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:05 2022] PUT /identity/v3/projects/17405fa6a217469eafc74c5965802d54/users/20e721e9e8134dffa80e0423eb398266/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:05.368060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.499365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03bbd-8ba3-44f2-9fcf-0e2cd6512627 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.501211 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.501919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.502330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.502629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.503385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.505044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.522457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.523196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.523527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.523873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.525270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.527941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.534593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 954/1901] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:05.542458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.557058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 948/1902] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:05.562915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2e4a-25cf-4352-8afd-aa0410815d78 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.563156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.575877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450639-e40a-401c-bbd4-256dcc713dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.577043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450639-e40a-401c-bbd4-256dcc713dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.577329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450639-e40a-401c-bbd4-256dcc713dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.577606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450639-e40a-401c-bbd4-256dcc713dec admin admin] PATH_INFO: `/v3/projects/abee7191d78348a7a8f99f8ec60329ef/users/dcd6e030b29740fcbb6fe8383b5a8cfe/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.580009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f300-c49e-40e7-8338-38c02b53c6a6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.589242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.590586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.590980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.591853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] PATH_INFO: `/v3/projects/17405fa6a217469eafc74c5965802d54/users/20e721e9e8134dffa80e0423eb398266/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.596560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17405fa6a217469eafc74c5965802d54, user_id=20e721e9e8134dffa80e0423eb398266, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.600670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.609197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450639-e40a-401c-bbd4-256dcc713dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=abee7191d78348a7a8f99f8ec60329ef, user_id=dcd6e030b29740fcbb6fe8383b5a8cfe, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.613152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450639-e40a-401c-bbd4-256dcc713dec admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.621274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:05.629206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 949/1903] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:05 2022] PUT /identity/v3/projects/17405fa6a217469eafc74c5965802d54/users/20e721e9e8134dffa80e0423eb398266/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:05.643074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 955/1904] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:05 2022] PUT /identity/v3/projects/abee7191d78348a7a8f99f8ec60329ef/users/dcd6e030b29740fcbb6fe8383b5a8cfe/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:05.649074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.657755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9322a7-4fc1-49e2-a097-d7631e25af34 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.658096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9322a7-4fc1-49e2-a097-d7631e25af34 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.658417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9322a7-4fc1-49e2-a097-d7631e25af34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.723674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5f9322a7-4fc1-49e2-a097-d7631e25af34 None None] MFA Rules not processed for user `20e721e9e8134dffa80e0423eb398266`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:05.725177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5f9322a7-4fc1-49e2-a097-d7631e25af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:05.766601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4915b-e19b-40cc-a429-72c8def2b236 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.776384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:05.879259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.880478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.880773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.881060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.881810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.886931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.920093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 950/1905] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:05.922838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 956/1906] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:14:05.927241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.935140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9322a7-4fc1-49e2-a097-d7631e25af34 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:05.938944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7c65d-f832-4670-b651-d578733d0e01 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:05.944284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc0ba1-7446-4761-9fdd-1739958d2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:05.945269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc0ba1-7446-4761-9fdd-1739958d2415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:05.945637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc0ba1-7446-4761-9fdd-1739958d2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:05.945991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc0ba1-7446-4761-9fdd-1739958d2415 admin admin] PATH_INFO: `/v3/projects/abee7191d78348a7a8f99f8ec60329ef/users/dcd6e030b29740fcbb6fe8383b5a8cfe/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:05.948267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc0ba1-7446-4761-9fdd-1739958d2415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abee7191d78348a7a8f99f8ec60329ef, user_id=dcd6e030b29740fcbb6fe8383b5a8cfe, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:05.951099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc0ba1-7446-4761-9fdd-1739958d2415 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:05.970307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 951/1907] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:05 2022] PUT /identity/v3/projects/abee7191d78348a7a8f99f8ec60329ef/users/dcd6e030b29740fcbb6fe8383b5a8cfe/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:06.009695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9322a7-4fc1-49e2-a097-d7631e25af34 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:06.066820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:06.067591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:06.068008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:06.068360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:06.125281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:06.151158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:06.154157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:06.172972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 957/1908] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:14:07.213906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c34b-ba16-4d25-96a3-d3fea6a24879 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:07.214462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c34b-ba16-4d25-96a3-d3fea6a24879 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:07.214566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c34b-ba16-4d25-96a3-d3fea6a24879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:07.264313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-deb4c34b-ba16-4d25-96a3-d3fea6a24879 None None] MFA Rules not processed for user `dcd6e030b29740fcbb6fe8383b5a8cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:07.265700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-deb4c34b-ba16-4d25-96a3-d3fea6a24879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:07.361148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 952/1909] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:07.373008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:07.385148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e99b-f32a-4009-b6ba-1b43107f873c service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:07.392177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b4f6b-4f84-4612-83b5-200ff194bdbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:07.393362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4f6b-4f84-4612-83b5-200ff194bdbf service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:07.393929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4f6b-4f84-4612-83b5-200ff194bdbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:07.394317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4f6b-4f84-4612-83b5-200ff194bdbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:07.469342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b4f6b-4f84-4612-83b5-200ff194bdbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:07.470873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b4f6b-4f84-4612-83b5-200ff194bdbf service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:07.481492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 958/1910] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:07.934244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c81b-bdef-43a6-9299-0a378c82974d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:07.934956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c81b-bdef-43a6-9299-0a378c82974d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:07.934956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c81b-bdef-43a6-9299-0a378c82974d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:07.936543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 953/1911] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:14:07.952413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3ebcd-8e7f-46ab-b8a2-a4ddec194587 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:07.952520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3ebcd-8e7f-46ab-b8a2-a4ddec194587 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:07.952862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3ebcd-8e7f-46ab-b8a2-a4ddec194587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:07.981667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-05b3ebcd-8e7f-46ab-b8a2-a4ddec194587 None None] MFA Rules not processed for user `6d604a09f0e04fd2ac41f31a4e13e166`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:07.983462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-05b3ebcd-8e7f-46ab-b8a2-a4ddec194587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:08.093547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 959/1912] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:14:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:08.114266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847c81b-bdef-43a6-9299-0a378c82974d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:08.116090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0847c81b-bdef-43a6-9299-0a378c82974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:08.138847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847c81b-bdef-43a6-9299-0a378c82974d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:08.144985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909b264-a1ba-4c6b-9845-89ece6e5312e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:08.145656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b264-a1ba-4c6b-9845-89ece6e5312e service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:08.145943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b264-a1ba-4c6b-9845-89ece6e5312e service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:08.146258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b264-a1ba-4c6b-9845-89ece6e5312e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:08.157094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909b264-a1ba-4c6b-9845-89ece6e5312e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:08.158816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909b264-a1ba-4c6b-9845-89ece6e5312e service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:08.169886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 954/1913] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:14:09.357310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3ebcd-8e7f-46ab-b8a2-a4ddec194587 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:09.418804 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3ebcd-8e7f-46ab-b8a2-a4ddec194587 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:09.423502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:09.424406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:09.424689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:09.424959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] PATH_INFO: `/v3/users/67975cf80cba4bcaa88034906e4e7d46` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:09.426219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67975cf80cba4bcaa88034906e4e7d46)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:09.428150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:09.451821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:09.478006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67975cf80cba4bcaa88034906e4e7d46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:09.489856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67975cf80cba4bcaa88034906e4e7d46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:09.498617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67975cf80cba4bcaa88034906e4e7d46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:09.507540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67975cf80cba4bcaa88034906e4e7d46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:09.508239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67975cf80cba4bcaa88034906e4e7d46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:09.527052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 960/1914] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:09 2022] DELETE /identity/v3/users/67975cf80cba4bcaa88034906e4e7d46 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:09.531988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:09.532456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:09.532684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:09.551857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:09.553115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:09.615226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 955/1915] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:09.625845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:09.627148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:09.694722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a931a-223e-4e09-8f45-1c579576c18b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:09.700986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:09.701655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:09.701938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:09.702240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:09.713431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:09.714902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:09.726667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 961/1916] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:10.089458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:10.091122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:10.100029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:10.104960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32183e2e-88ce-4cf8-95e2-f22d09728da6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:10.111279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:10.112156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:10.112449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:10.112703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] PATH_INFO: `/v3/projects/055c5e6a64be416ba2ccf835c1fba741` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:10.114065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055c5e6a64be416ba2ccf835c1fba741)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:10.116592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:10.164277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055c5e6a64be416ba2ccf835c1fba741', 'request_id': 'req-4970357c-383d-4ff4-a974-2bca1d9a15f6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.174669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055c5e6a64be416ba2ccf835c1fba741', 'request_id': 'req-4970357c-383d-4ff4-a974-2bca1d9a15f6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.180624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055c5e6a64be416ba2ccf835c1fba741', 'request_id': 'req-4970357c-383d-4ff4-a974-2bca1d9a15f6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.196113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] The token cache is being invalidate because project 055c5e6a64be416ba2ccf835c1fba741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:10.196400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.197066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.198853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 956/1917] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:10 2022] DELETE /identity/v3/projects/055c5e6a64be416ba2ccf835c1fba741 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:10.203061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:10.213152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831b39-8069-4e41-bbff-70da2c2f92d3 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:10.268482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:10.269287 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:10.269573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:10.269853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] PATH_INFO: `/v3/users/e45976f7fdde48e983a3d7bac6a89759` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:10.271091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45976f7fdde48e983a3d7bac6a89759)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:10.272996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:10.321002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:10.323361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45976f7fdde48e983a3d7bac6a89759'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.337359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45976f7fdde48e983a3d7bac6a89759'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.344828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45976f7fdde48e983a3d7bac6a89759'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.352917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45976f7fdde48e983a3d7bac6a89759'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.353566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0bb65d2-e995-4977-9b21-cdef319d65a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45976f7fdde48e983a3d7bac6a89759'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.359838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 962/1918] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:10 2022] DELETE /identity/v3/users/e45976f7fdde48e983a3d7bac6a89759 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:10.633262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:10.635438 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:10.651256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970357c-383d-4ff4-a974-2bca1d9a15f6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:10.716306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:10.717294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:10.717917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:10.717917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] PATH_INFO: `/v3/projects/d0289419d0f84b7c9c94abe3f256c034` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:10.719409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0289419d0f84b7c9c94abe3f256c034)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:10.721908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:10.772398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0289419d0f84b7c9c94abe3f256c034', 'request_id': 'req-02494f20-a5b8-4ee3-af11-ac4ba70496b3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.780027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0289419d0f84b7c9c94abe3f256c034', 'request_id': 'req-02494f20-a5b8-4ee3-af11-ac4ba70496b3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.785759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0289419d0f84b7c9c94abe3f256c034', 'request_id': 'req-02494f20-a5b8-4ee3-af11-ac4ba70496b3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.797210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] The token cache is being invalidate because project d0289419d0f84b7c9c94abe3f256c034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:10.797501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.798388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-02494f20-a5b8-4ee3-af11-ac4ba70496b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:10.799912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 957/1919] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:10 2022] DELETE /identity/v3/projects/d0289419d0f84b7c9c94abe3f256c034 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:10.804852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6754e-ace2-4f77-a890-051c838a6ad6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:10.805144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6754e-ace2-4f77-a890-051c838a6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:10.805427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6754e-ace2-4f77-a890-051c838a6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:10.825053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1cf6754e-ace2-4f77-a890-051c838a6ad6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:10.826297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1cf6754e-ace2-4f77-a890-051c838a6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:10.896960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 963/1920] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:10.904781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb137b5-cb3a-4b34-bec4-36e9b0f9922a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:10.905402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb137b5-cb3a-4b34-bec4-36e9b0f9922a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:10.905702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb137b5-cb3a-4b34-bec4-36e9b0f9922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:10.929774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-abb137b5-cb3a-4b34-bec4-36e9b0f9922a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:10.932363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-abb137b5-cb3a-4b34-bec4-36e9b0f9922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:10.950908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6754e-ace2-4f77-a890-051c838a6ad6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:10.952334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 958/1921] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:10.977397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6754e-ace2-4f77-a890-051c838a6ad6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:10.983951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:10.984707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:10.985002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:10.985282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:10.986030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:14:10.986368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:10.989800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:11.011559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 964/1922] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:14:11.017114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb137b5-cb3a-4b34-bec4-36e9b0f9922a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:11.026891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb137b5-cb3a-4b34-bec4-36e9b0f9922a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:11.033002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:11.033718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:11.034030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:11.034340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:11.035037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:11.036975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:11.046766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:11.079923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 959/1923] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:11 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:11.081347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:11.101739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4528-11f7-4bbc-8afd-2d896f14e00f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:11.174268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:11.175017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:11.175296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:11.175580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:11.176311 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:11.178280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:11.209472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 965/1924] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:11 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:11.210810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:11.223680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a4b4-1f2c-4398-a527-c3cd49a6c8cb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:11.229189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:11.229905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:11.230244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:11.230522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:11.231258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:11.232993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:11.243709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 960/1925] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:14:11.248402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:11.259287 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb425-d42b-421c-a678-bc9ad47e0585 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:11.265816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4028c-f504-412c-89b6-7900e9d684c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:11.266616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4028c-f504-412c-89b6-7900e9d684c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:11.266901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4028c-f504-412c-89b6-7900e9d684c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:11.267178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4028c-f504-412c-89b6-7900e9d684c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:11.267916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4028c-f504-412c-89b6-7900e9d684c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:11.269523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4028c-f504-412c-89b6-7900e9d684c3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:11.287895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 966/1926] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:11.289023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:11.300693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843087a3-e586-47ad-bece-82734eac70c1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:11.307369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:11.308267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:11.308550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:11.308828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] PATH_INFO: `/v3/projects/90b97e5230bb4d30a10f8314de4f4d42/users/8c56cd1659d1439193221dfb93902ad2/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:11.327649 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b97e5230bb4d30a10f8314de4f4d42, user_id=8c56cd1659d1439193221dfb93902ad2, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:11.330571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:11.344798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 961/1927] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:11 2022] PUT /identity/v3/projects/90b97e5230bb4d30a10f8314de4f4d42/users/8c56cd1659d1439193221dfb93902ad2/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:11.349953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0388337-d51c-42df-9efc-ed867db1b797 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:11.350272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0388337-d51c-42df-9efc-ed867db1b797 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:11.350552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0388337-d51c-42df-9efc-ed867db1b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:11.369252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c0388337-d51c-42df-9efc-ed867db1b797 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:11.370472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c0388337-d51c-42df-9efc-ed867db1b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:11.393489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:11.430023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 967/1928] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:11.440056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:11.441855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:11.501743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f87a-bf4b-4791-8933-e80b06d294d7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:11.505478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:11.506247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:11.506589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:11.506905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:11.517214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:11.518692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:11.529416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 962/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:12.347313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9aa1a-badf-48ee-b074-6ae80cb8ec97 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:12.347511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9aa1a-badf-48ee-b074-6ae80cb8ec97 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:12.347720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9aa1a-badf-48ee-b074-6ae80cb8ec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:12.381740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-57d9aa1a-badf-48ee-b074-6ae80cb8ec97 None None] MFA Rules not processed for user `8c56cd1659d1439193221dfb93902ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:12.383030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-57d9aa1a-badf-48ee-b074-6ae80cb8ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:12.467513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 968/1930] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:12.482228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:12.483771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:12.543438 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3e8e-53ac-4b64-bb1c-88185ba1be69 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:12.547812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:12.548592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:12.548977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:12.549766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:12.560904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:12.562916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:12.572875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 963/1931] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:13.315429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9aa1a-badf-48ee-b074-6ae80cb8ec97 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:13.326637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9aa1a-badf-48ee-b074-6ae80cb8ec97 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:13.333366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:13.334237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:13.335195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:13.335195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:13.336751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:13.416199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:13.418992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:13.448382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 969/1932] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:14.271877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:14.283425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913dce-7e39-4192-8b6e-13968745b65a service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:14.288420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157da0df-19b8-475d-a103-459a715d30fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:14.289528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157da0df-19b8-475d-a103-459a715d30fa service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:14.290034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157da0df-19b8-475d-a103-459a715d30fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:14.291155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157da0df-19b8-475d-a103-459a715d30fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:14.309713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-157da0df-19b8-475d-a103-459a715d30fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:14.401647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:14.406843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157da0df-19b8-475d-a103-459a715d30fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:14.409513 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157da0df-19b8-475d-a103-459a715d30fa service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:14.436409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 964/1933] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:14.990490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:14.995957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:15.014852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e053c-547e-4720-a447-3a77e6c46f70 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:15.019545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:15.020473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:15.020764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:15.021048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] PATH_INFO: `/v3/users/df439db17b6f4028b19010b7191c20da` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:15.022385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df439db17b6f4028b19010b7191c20da)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:15.024383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:15.079131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df439db17b6f4028b19010b7191c20da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:15.080670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:15.099088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df439db17b6f4028b19010b7191c20da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:15.107762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df439db17b6f4028b19010b7191c20da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:15.116836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df439db17b6f4028b19010b7191c20da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:15.117829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ce9c24a-1326-4fd2-aa39-b99151df87b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df439db17b6f4028b19010b7191c20da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:15.118373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:15.118695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:15.118974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:15.126663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 970/1934] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:14 2022] DELETE /identity/v3/users/df439db17b6f4028b19010b7191c20da => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:14:15.131480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:15.132053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:15.132533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:15.143363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] MFA Rules not processed for user `8c56cd1659d1439193221dfb93902ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:15.144850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:15.159901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:15.161372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:15.213587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 965/1935] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:15.238210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 971/1936] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:15.247949 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:15.250808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:15.377491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d5da1-2a9d-4315-bf86-be92bc4440e5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:15.393353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:15.394748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:15.395260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:15.396405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:15.410622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:15.412422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:15.432452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 966/1937] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:16.395407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:16.396955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:16.413472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b401-54d7-4483-8ed5-1984d41a2ae4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:16.419998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:16.421334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:16.421952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:16.422477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] PATH_INFO: `/v3/projects/1e22ac7bf216421189733427196b4514` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:16.423878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e22ac7bf216421189733427196b4514)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:16.426124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:16.510988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e22ac7bf216421189733427196b4514', 'request_id': 'req-c890b4a7-2988-42db-9ce0-40bc987742b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.519373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e22ac7bf216421189733427196b4514', 'request_id': 'req-c890b4a7-2988-42db-9ce0-40bc987742b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.527012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e22ac7bf216421189733427196b4514', 'request_id': 'req-c890b4a7-2988-42db-9ce0-40bc987742b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.545001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] The token cache is being invalidate because project 1e22ac7bf216421189733427196b4514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:16.545516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.546274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.548246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 972/1938] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:16 2022] DELETE /identity/v3/projects/1e22ac7bf216421189733427196b4514 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:16.552066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:16.563836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41b90e-dfd8-425b-a856-bf35c70ede34 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:16.636842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:16.638054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:16.638568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:16.639044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] PATH_INFO: `/v3/users/68f909dfd75d441686e92bc6a87c3296` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:16.640618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f909dfd75d441686e92bc6a87c3296)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:16.643023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:16.708539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:16.712780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f909dfd75d441686e92bc6a87c3296'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.714307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f909dfd75d441686e92bc6a87c3296'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.725854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f909dfd75d441686e92bc6a87c3296'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.726899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f909dfd75d441686e92bc6a87c3296'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.739385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-262829dc-5506-4518-92af-4d845c68bc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f909dfd75d441686e92bc6a87c3296'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:16.760320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 967/1939] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:14:16 2022] DELETE /identity/v3/users/68f909dfd75d441686e92bc6a87c3296 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:17.052755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.054466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:17.068124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890b4a7-2988-42db-9ce0-40bc987742b5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.118121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:17.131124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28316248-149a-452e-8397-02662b047f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.132003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28316248-149a-452e-8397-02662b047f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.132292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28316248-149a-452e-8397-02662b047f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.132650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28316248-149a-452e-8397-02662b047f19 admin admin] PATH_INFO: `/v3/projects/d3b88ad8f26448e78ba29c2c81f22c39` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.133943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28316248-149a-452e-8397-02662b047f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b88ad8f26448e78ba29c2c81f22c39)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.136389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28316248-149a-452e-8397-02662b047f19 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.183740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-28316248-149a-452e-8397-02662b047f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b88ad8f26448e78ba29c2c81f22c39', 'request_id': 'req-28316248-149a-452e-8397-02662b047f19'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:17.189811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-28316248-149a-452e-8397-02662b047f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b88ad8f26448e78ba29c2c81f22c39', 'request_id': 'req-28316248-149a-452e-8397-02662b047f19'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:17.195248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-28316248-149a-452e-8397-02662b047f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b88ad8f26448e78ba29c2c81f22c39', 'request_id': 'req-28316248-149a-452e-8397-02662b047f19'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:17.208540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-28316248-149a-452e-8397-02662b047f19 admin admin] The token cache is being invalidate because project d3b88ad8f26448e78ba29c2c81f22c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:14:17.208829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-28316248-149a-452e-8397-02662b047f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:17.209454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-28316248-149a-452e-8397-02662b047f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:14:17.211195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 973/1940] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:14:17 2022] DELETE /identity/v3/projects/d3b88ad8f26448e78ba29c2c81f22c39 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:17.216784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff8c84-b27a-45db-b1e0-01e35fa37f92 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.217124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff8c84-b27a-45db-b1e0-01e35fa37f92 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.217410 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff8c84-b27a-45db-b1e0-01e35fa37f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.237175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-eaff8c84-b27a-45db-b1e0-01e35fa37f92 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:17.238454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eaff8c84-b27a-45db-b1e0-01e35fa37f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:17.298327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 968/1941] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:14:17.306361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047a62f-3b1d-4097-9950-5acab46e093c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.306799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047a62f-3b1d-4097-9950-5acab46e093c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.307090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047a62f-3b1d-4097-9950-5acab46e093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.325745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7047a62f-3b1d-4097-9950-5acab46e093c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:17.326993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7047a62f-3b1d-4097-9950-5acab46e093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:17.335060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 974/1942] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:17.340040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff8c84-b27a-45db-b1e0-01e35fa37f92 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.349781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff8c84-b27a-45db-b1e0-01e35fa37f92 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.354788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.355459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.355738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.356018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.356766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:14:17.357051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.358746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.373073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 969/1943] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:14:17.375402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047a62f-3b1d-4097-9950-5acab46e093c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.385199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047a62f-3b1d-4097-9950-5acab46e093c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.389849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.390601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.390874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.391158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.391948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.393967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.422626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 975/1944] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:14:17 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:17.427708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.438458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e53bf-d5fb-49c4-a95d-34424a9e5f20 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.500339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.501035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.501319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.501600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.502481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.504286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.531469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 970/1945] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:14:17 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:14:17.535685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.545967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f79c1-f450-47d1-abd7-1d1031b72930 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.550640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.551231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.551516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.551793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.552537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.554125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.564942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 976/1946] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:17.568923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.579679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16ae1-434c-4ce0-b858-2e23ec510f08 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.584291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e44b3-ad54-4df7-84b1-d9f7446b9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.584973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e44b3-ad54-4df7-84b1-d9f7446b9f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.585256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e44b3-ad54-4df7-84b1-d9f7446b9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.585533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e44b3-ad54-4df7-84b1-d9f7446b9f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.586337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e44b3-ad54-4df7-84b1-d9f7446b9f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.588032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e44b3-ad54-4df7-84b1-d9f7446b9f10 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.598655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 971/1947] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:14:17.603352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.613492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c192f02-25d2-486b-a036-5b8b677a5354 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.618015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.619438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.619771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.620171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] PATH_INFO: `/v3/projects/39a297267dca493290e647bd90eaeefc/users/7b62c04bfcb64fa59bcf9a7c7b2be91b/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.635581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a297267dca493290e647bd90eaeefc, user_id=7b62c04bfcb64fa59bcf9a7c7b2be91b, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.638447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.652232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 977/1948] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:14:17 2022] PUT /identity/v3/projects/39a297267dca493290e647bd90eaeefc/users/7b62c04bfcb64fa59bcf9a7c7b2be91b/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:14:17.663680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.663978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.664263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.692496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] MFA Rules not processed for user `7b62c04bfcb64fa59bcf9a7c7b2be91b`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:14:17.693822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:17.708936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:17.774151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 972/1949] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:14:17.786236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:14:17.788132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:14:17.866363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841b88-8936-4278-b215-fad4131704a6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:14:17.870834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1aa60-3b49-4e51-bcc3-581676d79b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:14:17.871498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1aa60-3b49-4e51-bcc3-581676d79b3c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:14:17.871787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1aa60-3b49-4e51-bcc3-581676d79b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:14:17.872068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1aa60-3b49-4e51-bcc3-581676d79b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:14:17.882328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1aa60-3b49-4e51-bcc3-581676d79b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:14:17.883893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1aa60-3b49-4e51-bcc3-581676d79b3c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:14:17.896986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 978/1950] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:14:27.771205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=20 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:14:27.892693 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:04.035322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:04.037179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:04.114338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082bd8c-4aaf-4a41-a2ce-90fadbc595eb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:04.119928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:04.121029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:04.121417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:04.121779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] PATH_INFO: `/v3/users/57af4830196345489f468351fa780def` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:04.123404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57af4830196345489f468351fa780def)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:04.127009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:04.201255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57af4830196345489f468351fa780def'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:04.201946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57af4830196345489f468351fa780def'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:04.214829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57af4830196345489f468351fa780def'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:04.218988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57af4830196345489f468351fa780def'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:04.231154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57af4830196345489f468351fa780def'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:04.254787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 973/1951] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:04 2022] DELETE /identity/v3/users/57af4830196345489f468351fa780def => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:04.260189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:04.260743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:04.260743 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:04.280187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:04.281437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:04.369967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 979/1952] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:04.421914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:04.423522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:04.495385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2812a-2085-4627-970c-f29cf88d2668 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:04.499603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:04.500693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:04.501816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:04.502222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:04.515507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:04.517379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:04.531251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 974/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:05.667323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:05.669918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:05.699156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926fbf0-e223-42e7-8198-da8ccf303180 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:05.706946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:05.721563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:05.721896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:05.722199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] PATH_INFO: `/v3/projects/e48a527fb1f24a149bd0f4ef9d0a7208` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:05.725336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48a527fb1f24a149bd0f4ef9d0a7208)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:05.729430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:05.803903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48a527fb1f24a149bd0f4ef9d0a7208', 'request_id': 'req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:05.817761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48a527fb1f24a149bd0f4ef9d0a7208', 'request_id': 'req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:05.826537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48a527fb1f24a149bd0f4ef9d0a7208', 'request_id': 'req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:05.842017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] The token cache is being invalidate because project e48a527fb1f24a149bd0f4ef9d0a7208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:05.842392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:05.843167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6f7c48d0-d755-49c5-8bf4-e446f7cd9c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:05.844771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 980/1954] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:05 2022] DELETE /identity/v3/projects/e48a527fb1f24a149bd0f4ef9d0a7208 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:05.849044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:05.859992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b353-b497-4bbd-afce-5f12e0a36946 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:05.883199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:05.929700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:05.930777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:05.931063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:05.931338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] PATH_INFO: `/v3/users/20e721e9e8134dffa80e0423eb398266` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:05.932555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e721e9e8134dffa80e0423eb398266)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:05.934532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:05.991471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e721e9e8134dffa80e0423eb398266'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:05.992400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e721e9e8134dffa80e0423eb398266'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.000605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e721e9e8134dffa80e0423eb398266'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.001598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e721e9e8134dffa80e0423eb398266'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.019840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bd67824d-9409-4bb2-9ac8-e5f53cf3abf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e721e9e8134dffa80e0423eb398266'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.046988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 975/1955] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:05 2022] DELETE /identity/v3/users/20e721e9e8134dffa80e0423eb398266 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:06.206798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596851-40ae-45a5-96bc-960a0476fcad None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:06.207322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596851-40ae-45a5-96bc-960a0476fcad None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:06.207827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596851-40ae-45a5-96bc-960a0476fcad None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:06.210667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 981/1956] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:15:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:15:06.248384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:06.249041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:06.249513 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:06.295347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:06.297050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:06.467126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 976/1957] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:06.496419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596851-40ae-45a5-96bc-960a0476fcad None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:06.498446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-97596851-40ae-45a5-96bc-960a0476fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:06.519190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596851-40ae-45a5-96bc-960a0476fcad None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:06.525107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fe087-8811-4f40-bda9-d1299e2f3410 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:06.525840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe087-8811-4f40-bda9-d1299e2f3410 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:06.526135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe087-8811-4f40-bda9-d1299e2f3410 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:06.526450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe087-8811-4f40-bda9-d1299e2f3410 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:06.536050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fe087-8811-4f40-bda9-d1299e2f3410 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:06.537666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fe087-8811-4f40-bda9-d1299e2f3410 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:06.552685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 982/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:06.670988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:06.672531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:06.752369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:06.842743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045b02e-b4e2-494e-9d55-c87ff28b980b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:06.848807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:06.850062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:06.850632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:06.850632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] PATH_INFO: `/v3/projects/17405fa6a217469eafc74c5965802d54` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:06.852929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17405fa6a217469eafc74c5965802d54)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:06.856610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:06.933882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17405fa6a217469eafc74c5965802d54', 'request_id': 'req-9e59246a-c53a-429e-b6e0-856cb5d627f2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.956634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17405fa6a217469eafc74c5965802d54', 'request_id': 'req-9e59246a-c53a-429e-b6e0-856cb5d627f2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.965614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17405fa6a217469eafc74c5965802d54', 'request_id': 'req-9e59246a-c53a-429e-b6e0-856cb5d627f2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.980032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] The token cache is being invalidate because project 17405fa6a217469eafc74c5965802d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:06.980327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.981023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e59246a-c53a-429e-b6e0-856cb5d627f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:06.982890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 977/1959] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:06 2022] DELETE /identity/v3/projects/17405fa6a217469eafc74c5965802d54 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:06.989534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b06ef-e55e-4285-9640-57013745f5c2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:06.990658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b06ef-e55e-4285-9640-57013745f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:06.991073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b06ef-e55e-4285-9640-57013745f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.011534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7b2b06ef-e55e-4285-9640-57013745f5c2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:07.012892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7b2b06ef-e55e-4285-9640-57013745f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:07.098372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 983/1960] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:07.102470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec907-5571-4585-8880-68b616ac9a4d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.102829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec907-5571-4585-8880-68b616ac9a4d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.103183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec907-5571-4585-8880-68b616ac9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.128767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cdbec907-5571-4585-8880-68b616ac9a4d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:07.130857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cdbec907-5571-4585-8880-68b616ac9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:07.151666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 978/1961] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:07.153041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b06ef-e55e-4285-9640-57013745f5c2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.166397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b06ef-e55e-4285-9640-57013745f5c2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.177151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.179030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.180167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.180336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.184647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:07.185872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.190776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.206617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:07.228386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec907-5571-4585-8880-68b616ac9a4d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.236112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 984/1962] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:07.243580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec907-5571-4585-8880-68b616ac9a4d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.250499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.251210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.251490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.251768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.252833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.255434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.303452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 979/1963] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:07 2022] POST /identity/v3/projects => generated 409 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:07.311956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.332342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e826a5d-a40f-4e06-b72f-c1065e98fb0b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.350350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.352959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:07.419479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.420185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.420468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.421008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.421727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.423990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.454451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 985/1964] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:07 2022] POST /identity/v3/users => generated 305 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:07.458995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.467043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19f01-a971-4d32-91d8-68410e0b375f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.473353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.474310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.474618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.474864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] PATH_INFO: `/v3/users/5e19b50cb4e14b978f9786ab92b116ab` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.478259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745307fa-69de-4dec-b4fe-f021f6b86811 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.480510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e19b50cb4e14b978f9786ab92b116ab)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.482690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.511259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.512109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.512410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.512692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.513450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.515167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.531040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 986/1965] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:07.542119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.552698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:07.558842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5784-0b4e-456b-87c8-5244e18c87d7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.565768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.566489 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.566774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.567053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.568341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.569141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e19b50cb4e14b978f9786ab92b116ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.569654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.572209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e19b50cb4e14b978f9786ab92b116ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.585698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 987/1966] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:07.587273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e19b50cb4e14b978f9786ab92b116ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.589616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e19b50cb4e14b978f9786ab92b116ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.592016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.594701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:07.610291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e19b50cb4e14b978f9786ab92b116ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.614729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d5294-932d-4d05-8d1e-2a27a398f4da admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.620321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0256a-94b1-4e33-b83a-117b3cbf22b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.621626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0256a-94b1-4e33-b83a-117b3cbf22b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.622058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0256a-94b1-4e33-b83a-117b3cbf22b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.622632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0256a-94b1-4e33-b83a-117b3cbf22b6 admin admin] PATH_INFO: `/v3/projects/cab65fe8b16043a1bfc96b880ddda296/users/1c82cc79eb5542c189dd6d6480eb0ef4/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.636274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 980/1967] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:07 2022] DELETE /identity/v3/users/5e19b50cb4e14b978f9786ab92b116ab => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:07.639488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.642044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0256a-94b1-4e33-b83a-117b3cbf22b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab65fe8b16043a1bfc96b880ddda296, user_id=1c82cc79eb5542c189dd6d6480eb0ef4, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.644979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0256a-94b1-4e33-b83a-117b3cbf22b6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.648478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:07.676166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 988/1968] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:07 2022] PUT /identity/v3/projects/cab65fe8b16043a1bfc96b880ddda296/users/1c82cc79eb5542c189dd6d6480eb0ef4/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:07.678410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85ff66-6699-4d3e-9a79-3cb2a1d73955 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.678702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85ff66-6699-4d3e-9a79-3cb2a1d73955 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.678986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85ff66-6699-4d3e-9a79-3cb2a1d73955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.720883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3b85ff66-6699-4d3e-9a79-3cb2a1d73955 None None] MFA Rules not processed for user `1c82cc79eb5542c189dd6d6480eb0ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:07.723235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3b85ff66-6699-4d3e-9a79-3cb2a1d73955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:07.734434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f817df-ab38-4d74-8304-9ceaa073bbcf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.829639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.829639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.829639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.829639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] PATH_INFO: `/v3/users/7b62c04bfcb64fa59bcf9a7c7b2be91b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.830525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b62c04bfcb64fa59bcf9a7c7b2be91b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.832653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.870153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 989/1969] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:07.871154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85ff66-6699-4d3e-9a79-3cb2a1d73955 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.886345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85ff66-6699-4d3e-9a79-3cb2a1d73955 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:07.891465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:07.892604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:07.892892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:07.893168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:07.894767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:07.897111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:07.933914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 990/1970] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:07 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:07.935101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:07.945184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b62c04bfcb64fa59bcf9a7c7b2be91b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.946570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b62c04bfcb64fa59bcf9a7c7b2be91b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.956552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:07.971743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b62c04bfcb64fa59bcf9a7c7b2be91b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.973451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b62c04bfcb64fa59bcf9a7c7b2be91b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:07.990772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b62c04bfcb64fa59bcf9a7c7b2be91b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.003300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:08.034330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 981/1971] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:07 2022] DELETE /identity/v3/users/7b62c04bfcb64fa59bcf9a7c7b2be91b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:08.041110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.042634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.046931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6152-8fd3-493a-8ba1-5c49ef1d7829 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.140341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15300e62-5133-487b-bf2c-763eb5c9ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.141654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300e62-5133-487b-bf2c-763eb5c9ffd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.142220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300e62-5133-487b-bf2c-763eb5c9ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.142825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300e62-5133-487b-bf2c-763eb5c9ffd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.144001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15300e62-5133-487b-bf2c-763eb5c9ffd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.146015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15300e62-5133-487b-bf2c-763eb5c9ffd9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.147743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715191fd-fa74-4929-b676-6fb9903c9f3c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.153171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.154761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.155097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.155901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] PATH_INFO: `/v3/projects/8900dece4ef643d1a3556feb3a2738fd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.158745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8900dece4ef643d1a3556feb3a2738fd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.161188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.189010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 991/1972] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:07 2022] POST /identity/v3/users => generated 309 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:08.190486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.190776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.191052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.216242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:08.217494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.234871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 992/1973] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:08.234871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.234871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.241290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b24568-b476-4437-8760-9fe5f0871b94 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.244162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8900dece4ef643d1a3556feb3a2738fd', 'request_id': 'req-9a329311-12aa-4a26-8688-8de8ed02d97a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.253352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8900dece4ef643d1a3556feb3a2738fd', 'request_id': 'req-9a329311-12aa-4a26-8688-8de8ed02d97a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.261027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8900dece4ef643d1a3556feb3a2738fd', 'request_id': 'req-9a329311-12aa-4a26-8688-8de8ed02d97a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.274359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] The token cache is being invalidate because project 8900dece4ef643d1a3556feb3a2738fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:08.274650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.275340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.276951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 982/1974] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:08 2022] DELETE /identity/v3/projects/8900dece4ef643d1a3556feb3a2738fd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:08.277726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.279075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.328027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.328771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.329063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.329348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.330250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.332072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.347099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 993/1975] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:08.352694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.354909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.356049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329311-12aa-4a26-8688-8de8ed02d97a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.360495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.361465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.361819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.362190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.364270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.368754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdb8bf-2721-4fd8-b4f1-97760639849e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.373959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.374995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.375283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.375561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] PATH_INFO: `/v3/users/dcd6e030b29740fcbb6fe8383b5a8cfe` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.376821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd6e030b29740fcbb6fe8383b5a8cfe)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.379065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.382206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.384346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.396067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 983/1976] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:08.397023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.399152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.413370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b4390-95a6-49dc-94f7-21a4bea869a5 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.420401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.421738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.421978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.422324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] PATH_INFO: `/v3/projects/35ca03896dbc4147abbba0ab69937fb6/users/22eafceda80a48b29e9da64346a1c734/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.425404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:08.441788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ca03896dbc4147abbba0ab69937fb6, user_id=22eafceda80a48b29e9da64346a1c734, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.445560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.449839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:08.459786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd6e030b29740fcbb6fe8383b5a8cfe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.479168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 984/1977] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:08 2022] PUT /identity/v3/projects/35ca03896dbc4147abbba0ab69937fb6/users/22eafceda80a48b29e9da64346a1c734/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:08.483305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.510641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd6e030b29740fcbb6fe8383b5a8cfe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.520548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd6e030b29740fcbb6fe8383b5a8cfe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.541832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd6e030b29740fcbb6fe8383b5a8cfe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.542912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd6e030b29740fcbb6fe8383b5a8cfe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:08.554916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 994/1978] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:08 2022] DELETE /identity/v3/users/dcd6e030b29740fcbb6fe8383b5a8cfe => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:08.626460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067150c-b6f0-4f2c-8b09-75340c4e17c2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.704499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f91f5-6bfd-4995-bbc4-53b6330ed7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.705320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f91f5-6bfd-4995-bbc4-53b6330ed7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.705704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f91f5-6bfd-4995-bbc4-53b6330ed7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.706896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f91f5-6bfd-4995-bbc4-53b6330ed7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.707673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f91f5-6bfd-4995-bbc4-53b6330ed7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.709327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f91f5-6bfd-4995-bbc4-53b6330ed7a3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.721188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 985/1979] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:08.724863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.726761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.745377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732a9a-d55f-4140-8147-5f7b1b88774c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:08.751772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:08.752984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.753429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.753863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] PATH_INFO: `/v3/projects/35ca03896dbc4147abbba0ab69937fb6/users/22eafceda80a48b29e9da64346a1c734/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.756041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ca03896dbc4147abbba0ab69937fb6, user_id=22eafceda80a48b29e9da64346a1c734, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:08.759429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:08.778767 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 995/1980] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:08 2022] PUT /identity/v3/projects/35ca03896dbc4147abbba0ab69937fb6/users/22eafceda80a48b29e9da64346a1c734/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:08.783776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:08.784058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:08.784340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:08.815666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] MFA Rules not processed for user `22eafceda80a48b29e9da64346a1c734`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:08.816687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.908820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.911095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:08.978159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 986/1981] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:08.987717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:08.989174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.043529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04d32e-dee3-4c94-a862-839336f0e9f5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.051999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.053247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.053247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.053537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:09.053630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] PATH_INFO: `/v3/projects/abee7191d78348a7a8f99f8ec60329ef` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.055799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abee7191d78348a7a8f99f8ec60329ef)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.059404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.103409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a840db-8143-4317-b3fe-077c21f87e05 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.107557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.108260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.108603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.108965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.121256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.122801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.134409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 987/1982] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:09.136185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.138122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.139731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abee7191d78348a7a8f99f8ec60329ef', 'request_id': 'req-ef1a9167-0ba0-4789-885d-8f2840d4fb71'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.149834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abee7191d78348a7a8f99f8ec60329ef', 'request_id': 'req-ef1a9167-0ba0-4789-885d-8f2840d4fb71'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.155858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ded24-64d7-4c92-8df6-59259bc91b97 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.158450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abee7191d78348a7a8f99f8ec60329ef', 'request_id': 'req-ef1a9167-0ba0-4789-885d-8f2840d4fb71'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.197948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] The token cache is being invalidate because project abee7191d78348a7a8f99f8ec60329ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:09.198303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.199986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef1a9167-0ba0-4789-885d-8f2840d4fb71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.202020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 996/1983] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:08 2022] DELETE /identity/v3/projects/abee7191d78348a7a8f99f8ec60329ef => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:09.207635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b9ab-38f9-4475-9e02-5bd2ffdc30a3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.207981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b9ab-38f9-4475-9e02-5bd2ffdc30a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.208225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b9ab-38f9-4475-9e02-5bd2ffdc30a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.231363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-46f3b9ab-38f9-4475-9e02-5bd2ffdc30a3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:09.232604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-46f3b9ab-38f9-4475-9e02-5bd2ffdc30a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.253852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:09.278828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.280024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.280522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.280986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] PATH_INFO: `/v3/projects/39a297267dca493290e647bd90eaeefc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.282534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a297267dca493290e647bd90eaeefc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.284807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.334338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 997/1984] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:09.336867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f12b-f974-432a-b250-7a3ec11e4780 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.337166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f12b-f974-432a-b250-7a3ec11e4780 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.337483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f12b-f974-432a-b250-7a3ec11e4780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.368568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-32a8f12b-f974-432a-b250-7a3ec11e4780 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:09.371737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-32a8f12b-f974-432a-b250-7a3ec11e4780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.405908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a297267dca493290e647bd90eaeefc', 'request_id': 'req-8a983473-2f17-4268-ba91-bd30035bba67'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.423394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a297267dca493290e647bd90eaeefc', 'request_id': 'req-8a983473-2f17-4268-ba91-bd30035bba67'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.437194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a297267dca493290e647bd90eaeefc', 'request_id': 'req-8a983473-2f17-4268-ba91-bd30035bba67'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.459327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] The token cache is being invalidate because project 39a297267dca493290e647bd90eaeefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:09.459702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.461021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:09.463158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 988/1985] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:09 2022] DELETE /identity/v3/projects/39a297267dca493290e647bd90eaeefc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:09.466217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.467825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.501632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 998/1986] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:09.503155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db0c71-55ab-4907-b1a2-6ffe38de99b8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.503512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db0c71-55ab-4907-b1a2-6ffe38de99b8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.503869 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db0c71-55ab-4907-b1a2-6ffe38de99b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.532379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c7db0c71-55ab-4907-b1a2-6ffe38de99b8 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:09.533830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c7db0c71-55ab-4907-b1a2-6ffe38de99b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.552466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 999/1987] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:09.552466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db0c71-55ab-4907-b1a2-6ffe38de99b8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.558875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db0c71-55ab-4907-b1a2-6ffe38de99b8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.564035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e4301-009d-4fe2-a889-01671b04ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.564860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4301-009d-4fe2-a889-01671b04ffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.565145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4301-009d-4fe2-a889-01671b04ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.565590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4301-009d-4fe2-a889-01671b04ffa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.569105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4301-009d-4fe2-a889-01671b04ffa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:09.569105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4301-009d-4fe2-a889-01671b04ffa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.569105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4301-009d-4fe2-a889-01671b04ffa5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.588674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1000/1988] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:09.588881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a983473-2f17-4268-ba91-bd30035bba67 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.589005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545eb64-1ba0-432c-81a7-9eb983323532 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.589005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545eb64-1ba0-432c-81a7-9eb983323532 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.589005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545eb64-1ba0-432c-81a7-9eb983323532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.594828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.595599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.595959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.596312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.598415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.611274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:09.617296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8545eb64-1ba0-432c-81a7-9eb983323532 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:09.618818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8545eb64-1ba0-432c-81a7-9eb983323532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:09.634397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1001/1989] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:09.637236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545eb64-1ba0-432c-81a7-9eb983323532 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.655301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545eb64-1ba0-432c-81a7-9eb983323532 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.663224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.664079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.664436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.664811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.665685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.667653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.700008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1002/1990] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:09.700977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.724568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.726794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.738816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 989/1991] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:09.754305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.782448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1580-3d87-421b-91fe-f75cfbb7d1f6 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.785870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59485efa-10d2-4b40-9b95-d99168fa2833 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.792394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.793307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.793596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.793878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.794983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:09.795246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.797173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.799626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.800887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.802608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.803143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.805534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.811226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.814981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1003/1992] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:09.820587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.834584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35144-50b5-4256-bcc7-7adb19633e4d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.841731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.841954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 990/1993] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:09.842925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.843391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.843727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.844473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.846848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.847480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.859371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:09.863218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df90e-e378-4db4-ae5a-994e10744bc9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.871437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:09.872315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:09.872681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:09.873333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:09.874279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:09.876034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:09.892617 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 991/1994] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:09.895938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1004/1995] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:09.896352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.908458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf3bd-d62f-4e56-84c5-84e6e27af955 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:09.908647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:09.997816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c046a7-1a8f-4dcc-b05e-76dd3630d713 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.003831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.004824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.005123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.005495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.006207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.009205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.026238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.027930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.028607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.029131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.030963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.033678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.039616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1005/1996] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:09 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:15:10.040908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.051739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 992/1997] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:10.056411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.057421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7c8b9-6c5b-49b9-a04a-ef8bf94becb8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.065757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.067235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.067925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.068518 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.069588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.072078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.078093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63b93-9c4d-4598-9488-c8050dba11f4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.087650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1006/1998] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:10.090531 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.094269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c020a-9a0d-4c17-9761-941807b59331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.095432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c020a-9a0d-4c17-9761-941807b59331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.096841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c020a-9a0d-4c17-9761-941807b59331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.097699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c020a-9a0d-4c17-9761-941807b59331 admin admin] PATH_INFO: `/v3/projects/abae7f38546247e8bce00626880e0d2d/users/100e19e178f4448484537286ab6f878a/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.103539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9f73-e075-4f74-83dd-fc10498b72f3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.108714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.109508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.110472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.110472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.111502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.113845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.124879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c020a-9a0d-4c17-9761-941807b59331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abae7f38546247e8bce00626880e0d2d, user_id=100e19e178f4448484537286ab6f878a, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.127682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1007/1999] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:10.128312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c020a-9a0d-4c17-9761-941807b59331 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.132081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.144243 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a85512-4837-45bc-9c8d-ec440ccc6626 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.166787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 993/2000] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:10 2022] PUT /identity/v3/projects/abae7f38546247e8bce00626880e0d2d/users/100e19e178f4448484537286ab6f878a/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:10.169460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876ea2-ea63-4f9f-98a3-f5405e5f0f9d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.169838 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876ea2-ea63-4f9f-98a3-f5405e5f0f9d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.170204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876ea2-ea63-4f9f-98a3-f5405e5f0f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.205059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-74876ea2-ea63-4f9f-98a3-f5405e5f0f9d None None] MFA Rules not processed for user `100e19e178f4448484537286ab6f878a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:10.206671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-74876ea2-ea63-4f9f-98a3-f5405e5f0f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:10.293982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39fa17-8d14-4df8-9ce2-ff0c5cafa2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.295056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fa17-8d14-4df8-9ce2-ff0c5cafa2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.295493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fa17-8d14-4df8-9ce2-ff0c5cafa2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.295864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fa17-8d14-4df8-9ce2-ff0c5cafa2f3 admin admin] PATH_INFO: `/v3/projects/ad0dac0ddbad44a79513569c48a91677/users/890630c6ed4b42f787170163027c5f93/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.297634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:10.319725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39fa17-8d14-4df8-9ce2-ff0c5cafa2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0dac0ddbad44a79513569c48a91677, user_id=890630c6ed4b42f787170163027c5f93, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.323505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39fa17-8d14-4df8-9ce2-ff0c5cafa2f3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.362103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1008/2001] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:10 2022] PUT /identity/v3/projects/ad0dac0ddbad44a79513569c48a91677/users/890630c6ed4b42f787170163027c5f93/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:10.365419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 994/2002] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:10.371242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bd136-143b-4dd4-812a-4f67e3d0cc17 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.371500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bd136-143b-4dd4-812a-4f67e3d0cc17 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.372098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bd136-143b-4dd4-812a-4f67e3d0cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.382585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74876ea2-ea63-4f9f-98a3-f5405e5f0f9d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.432558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1b9bd136-143b-4dd4-812a-4f67e3d0cc17 None None] MFA Rules not processed for user `890630c6ed4b42f787170163027c5f93`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:10.433825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b9bd136-143b-4dd4-812a-4f67e3d0cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:10.461926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74876ea2-ea63-4f9f-98a3-f5405e5f0f9d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.478772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:10.534400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.535689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.536163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.536530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.555737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1009/2003] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:10.563331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bd136-143b-4dd4-812a-4f67e3d0cc17 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.622985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.624509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.636725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 995/2004] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:10.652434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bd136-143b-4dd4-812a-4f67e3d0cc17 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.657109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.657773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.658058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.658367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.659152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.661003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.667745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.680295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17fe2-8d41-427a-af63-325458828057 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.690525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.691795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.692255 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.692679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] PATH_INFO: `/v3/users/100e19e178f4448484537286ab6f878a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.694349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100e19e178f4448484537286ab6f878a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.697189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.722948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1010/2005] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:10 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:10.728377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.768756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100e19e178f4448484537286ab6f878a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:10.769445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100e19e178f4448484537286ab6f878a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:10.771356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:10.781270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100e19e178f4448484537286ab6f878a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:10.782028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100e19e178f4448484537286ab6f878a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:10.795533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-538db7bd-77b9-490c-aefd-8159cf870ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100e19e178f4448484537286ab6f878a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:10.817990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 996/2006] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:10 2022] DELETE /identity/v3/users/100e19e178f4448484537286ab6f878a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:10.819490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.819811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.820091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.828668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c535b-69bf-468d-ba88-042cd19b5623 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.842494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:10.843709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:10.908187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.909395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.909501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.909897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.910732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.912735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.916234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 997/2007] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:10.927032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:10.932206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.934252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:10.949742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1011/2008] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:10 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:10.954435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:10.956575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:10.972286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8967fe-799b-4754-be57-d0fec8967ce5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:10.978829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:10.979949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:10.979949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:10.980185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:10.980806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:10.982671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:10.997690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1012/2009] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:11.001525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.012164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af3db-46f8-4ba3-be89-108dbc531892 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.012607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d2903-177d-44a1-8436-885968440f3c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.016625 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053460f2-eb4f-4f70-97cb-5dd0b36b9a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.017355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053460f2-eb4f-4f70-97cb-5dd0b36b9a98 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.017576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053460f2-eb4f-4f70-97cb-5dd0b36b9a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.017849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053460f2-eb4f-4f70-97cb-5dd0b36b9a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.017946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.018774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.019043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.019328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.020073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.021726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.030469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053460f2-eb4f-4f70-97cb-5dd0b36b9a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.031940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053460f2-eb4f-4f70-97cb-5dd0b36b9a98 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.037314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1013/2010] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:11.038558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.045307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 998/2011] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:11.050300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd03ae2-e63c-4437-85f0-849fd85fc9d1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.057603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.059305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.059848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.060389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] PATH_INFO: `/v3/projects/07a88509a5e54ef2b6866bff300e20b8/users/fc6ce7b0b522471ea98b9af096254d6a/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.081658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a88509a5e54ef2b6866bff300e20b8, user_id=fc6ce7b0b522471ea98b9af096254d6a, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.084453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.109478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1014/2012] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:11 2022] PUT /identity/v3/projects/07a88509a5e54ef2b6866bff300e20b8/users/fc6ce7b0b522471ea98b9af096254d6a/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:11.120103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377406-0abe-41a9-ac83-1e2f266cc388 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.120429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377406-0abe-41a9-ac83-1e2f266cc388 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.120704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377406-0abe-41a9-ac83-1e2f266cc388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.157861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f0377406-0abe-41a9-ac83-1e2f266cc388 None None] MFA Rules not processed for user `fc6ce7b0b522471ea98b9af096254d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:11.160585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0377406-0abe-41a9-ac83-1e2f266cc388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:11.277728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:11.289674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 999/2013] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:11.296079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.438856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319348e-1cf9-4b41-bcb1-d4db592e0019 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.445173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.446977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.447441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.447823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.448662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.452402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.523604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1015/2014] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:11 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:11.524389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377406-0abe-41a9-ac83-1e2f266cc388 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.547071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377406-0abe-41a9-ac83-1e2f266cc388 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.655665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.656779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.657272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.658076 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.659398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.662273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.696519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1000/2015] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:11 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:11.700133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.731319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d833afd-e721-4f00-a095-aa2225dd6a69 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.737118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.737817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.738161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.738549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.739242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.741102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.743374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.745720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:11.758373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1016/2016] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:11.761440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.775528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874833e6-cda0-4fbe-a9ac-2fc47b24e061 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.782024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.783585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.784079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.784439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] PATH_INFO: `/v3/projects/5c725fbaaf064e2da4dc2e35d57f1b2c/users/7b9e5828b0fd4ce49c0b1eb9da598844/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.796995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712e8c-22a8-4876-b191-85cb09549906 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.810112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:11.811031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.811317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.811593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] PATH_INFO: `/v3/projects/abae7f38546247e8bce00626880e0d2d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.813545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c725fbaaf064e2da4dc2e35d57f1b2c, user_id=7b9e5828b0fd4ce49c0b1eb9da598844, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.814063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abae7f38546247e8bce00626880e0d2d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:11.818010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.821211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:11.840711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1017/2017] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:11 2022] PUT /identity/v3/projects/5c725fbaaf064e2da4dc2e35d57f1b2c/users/7b9e5828b0fd4ce49c0b1eb9da598844/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:11.845546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:11.913195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abae7f38546247e8bce00626880e0d2d', 'request_id': 'req-8010bd14-c133-4463-a809-6749c7393a80'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:11.925364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abae7f38546247e8bce00626880e0d2d', 'request_id': 'req-8010bd14-c133-4463-a809-6749c7393a80'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:11.931677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:11.934323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abae7f38546247e8bce00626880e0d2d', 'request_id': 'req-8010bd14-c133-4463-a809-6749c7393a80'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:11.942677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb1e5-fbcd-446b-89ac-9d47ae1c2ba3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:11.955679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] The token cache is being invalidate because project abae7f38546247e8bce00626880e0d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:11.956247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:11.957402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8010bd14-c133-4463-a809-6749c7393a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:11.961555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1001/2018] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:11 2022] DELETE /identity/v3/projects/abae7f38546247e8bce00626880e0d2d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:11.968315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330ce4-76aa-4e21-9b9c-3cfabd79d6f9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:11.968695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330ce4-76aa-4e21-9b9c-3cfabd79d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:11.969117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330ce4-76aa-4e21-9b9c-3cfabd79d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:11.996753 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-90330ce4-76aa-4e21-9b9c-3cfabd79d6f9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:11.996753 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-90330ce4-76aa-4e21-9b9c-3cfabd79d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.043922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.044884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.045943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.046464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.047222 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.048882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.063206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1018/2019] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:12.067360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.069415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.070595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1002/2020] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:12.077991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286758-a8d9-467e-bf10-2405b3f3af65 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.078497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286758-a8d9-467e-bf10-2405b3f3af65 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.078921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286758-a8d9-467e-bf10-2405b3f3af65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.086331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3402a4-429e-4656-b690-1cf27db2f0fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.091862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbd48d-2c69-4224-8ffc-28ae32e1e840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.092796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd48d-2c69-4224-8ffc-28ae32e1e840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.093081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd48d-2c69-4224-8ffc-28ae32e1e840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.093364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd48d-2c69-4224-8ffc-28ae32e1e840 admin admin] PATH_INFO: `/v3/projects/5c725fbaaf064e2da4dc2e35d57f1b2c/users/7b9e5828b0fd4ce49c0b1eb9da598844/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.095805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbd48d-2c69-4224-8ffc-28ae32e1e840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c725fbaaf064e2da4dc2e35d57f1b2c, user_id=7b9e5828b0fd4ce49c0b1eb9da598844, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.098565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbd48d-2c69-4224-8ffc-28ae32e1e840 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.103169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ec286758-a8d9-467e-bf10-2405b3f3af65 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:12.104490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ec286758-a8d9-467e-bf10-2405b3f3af65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.111884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:12.114400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1019/2021] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:12 2022] PUT /identity/v3/projects/5c725fbaaf064e2da4dc2e35d57f1b2c/users/7b9e5828b0fd4ce49c0b1eb9da598844/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:12.125785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.125785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.126933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.169107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] MFA Rules not processed for user `7b9e5828b0fd4ce49c0b1eb9da598844`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:12.170970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.208697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1003/2022] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:12.214489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286758-a8d9-467e-bf10-2405b3f3af65 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.224764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286758-a8d9-467e-bf10-2405b3f3af65 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.231334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.232171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.232530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.232732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.233582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:12.234250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.235646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.254379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1004/2023] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:15:12.255593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.267312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1020/2024] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:12.270427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921902f7-6c00-4b8d-be52-835bfe51e94f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.276757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.277596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.277984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.278387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.279294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.280910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.281520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.282654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.321462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1005/2025] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:12 2022] POST /identity/v3/projects => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:12.325555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.374882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed1bb-1eca-448e-bc6c-452033a2bfe5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.405342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:12.409279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea588-f258-4170-bc1d-f84d0ea44e4d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.417057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.417475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.418570 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.418856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.419582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.426909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.448904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b032c0-ae82-43af-b4ef-8b6183f8b251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.449607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b032c0-ae82-43af-b4ef-8b6183f8b251 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.449992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b032c0-ae82-43af-b4ef-8b6183f8b251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.450445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b032c0-ae82-43af-b4ef-8b6183f8b251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.452863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-99b032c0-ae82-43af-b4ef-8b6183f8b251 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.472140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1006/2026] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:12 2022] POST /identity/v3/users => generated 280 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:12.474646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.487651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b62cdc-b48f-488f-9c64-d31f48f31544 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.494473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.495280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.495642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.495997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.497131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.498868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.511203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1007/2027] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:12.515094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.528341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b83bb-d87d-49c9-a9f5-4e496f7439fe admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.533516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.534363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.534719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.535089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.535901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.537743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.541528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b032c0-ae82-43af-b4ef-8b6183f8b251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.543000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b032c0-ae82-43af-b4ef-8b6183f8b251 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.553371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1008/2028] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:12.555171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.562293 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1021/2029] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:12.573712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca33ca-43cf-4671-a1ee-46aa302dedda admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.579744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.580772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.581152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.581526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] PATH_INFO: `/v3/projects/4179e3eb1ffc47b194e4de839a061d21/users/3e17b437179b475db36bb0a4e19d0045/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.599143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179e3eb1ffc47b194e4de839a061d21, user_id=3e17b437179b475db36bb0a4e19d0045, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.602800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.622259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1009/2030] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:12 2022] PUT /identity/v3/projects/4179e3eb1ffc47b194e4de839a061d21/users/3e17b437179b475db36bb0a4e19d0045/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:12.630314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84c67e-748a-4214-aaef-4bf7d0ca5d6f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.630857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84c67e-748a-4214-aaef-4bf7d0ca5d6f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.631240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84c67e-748a-4214-aaef-4bf7d0ca5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.667576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fd84c67e-748a-4214-aaef-4bf7d0ca5d6f None None] MFA Rules not processed for user `3e17b437179b475db36bb0a4e19d0045`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:12.668876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fd84c67e-748a-4214-aaef-4bf7d0ca5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.789335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1022/2031] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:12.820668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:12.824060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:12.873407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:12.923322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5361a7a-88de-485f-850a-1757e2ad835f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:12.927649 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c02a0d-fc05-463b-a4ce-609c644fdfde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:12.928518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02a0d-fc05-463b-a4ce-609c644fdfde service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:12.928817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02a0d-fc05-463b-a4ce-609c644fdfde service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:12.929371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02a0d-fc05-463b-a4ce-609c644fdfde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:12.941185 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c02a0d-fc05-463b-a4ce-609c644fdfde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:12.947751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c02a0d-fc05-463b-a4ce-609c644fdfde service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:12.968951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1010/2032] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:12.986668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84c67e-748a-4214-aaef-4bf7d0ca5d6f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:13.069522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84c67e-748a-4214-aaef-4bf7d0ca5d6f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:13.074466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:13.075464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:13.075823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:13.076181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] PATH_INFO: `/v3/users/3e17b437179b475db36bb0a4e19d0045` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:13.077465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e17b437179b475db36bb0a4e19d0045)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:13.079972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:13.100122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:13.149290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e17b437179b475db36bb0a4e19d0045'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.167383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e17b437179b475db36bb0a4e19d0045'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.175659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e17b437179b475db36bb0a4e19d0045'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.186516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e17b437179b475db36bb0a4e19d0045'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.187451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e17b437179b475db36bb0a4e19d0045'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.195929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1023/2033] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:12 2022] DELETE /identity/v3/users/3e17b437179b475db36bb0a4e19d0045 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:13.200689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:13.201198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:13.201275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:13.224018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:13.225321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:13.289777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1011/2034] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:13.299653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:13.301143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:13.363936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0731-1931-4a5e-b204-cdec1625969c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:13.367742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:13.368425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:13.368714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:13.368996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:13.381266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:13.383533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:13.394626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1024/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:13.734253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:13.735896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:13.759720 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8f88-17ac-4c37-950e-ac1169822acb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:13.766155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:13.767480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:13.767793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:13.768207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] PATH_INFO: `/v3/projects/4179e3eb1ffc47b194e4de839a061d21` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:13.769669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4179e3eb1ffc47b194e4de839a061d21)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:13.771877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:13.827688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4179e3eb1ffc47b194e4de839a061d21', 'request_id': 'req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.835669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4179e3eb1ffc47b194e4de839a061d21', 'request_id': 'req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.843756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4179e3eb1ffc47b194e4de839a061d21', 'request_id': 'req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.855887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] The token cache is being invalidate because project 4179e3eb1ffc47b194e4de839a061d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:13.856176 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.856836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:13.858459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1012/2036] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:13 2022] DELETE /identity/v3/projects/4179e3eb1ffc47b194e4de839a061d21 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:17.526069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:17.528193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:17.651667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c53c6e-8988-4f61-a297-e8a4592be9d8 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:17.743140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:17.750957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:17.751640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:17.752158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:17.752985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:17.755520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:17.826843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:17.828300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:17.840010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1025/2037] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:18.450543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:18.452064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:18.466060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbd93-3c01-4ea6-8930-42f2fb461ad3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:18.469924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216c7bb-3848-47f6-ab01-e355dd87a97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:18.470954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c7bb-3848-47f6-ab01-e355dd87a97f service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:18.471239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c7bb-3848-47f6-ab01-e355dd87a97f service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:18.471511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c7bb-3848-47f6-ab01-e355dd87a97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:18.473413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5216c7bb-3848-47f6-ab01-e355dd87a97f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:18.527996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:18.556986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216c7bb-3848-47f6-ab01-e355dd87a97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:18.558484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216c7bb-3848-47f6-ab01-e355dd87a97f service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:18.567998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1013/2038] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:20.031301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:20.033524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:20.128378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458a8c-074c-4c2e-81fb-c4aaa0f29362 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:20.136070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:20.137207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:20.137599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:20.138054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] PATH_INFO: `/v3/users/1c82cc79eb5542c189dd6d6480eb0ef4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:20.140353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c82cc79eb5542c189dd6d6480eb0ef4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:20.143403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:20.206494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c82cc79eb5542c189dd6d6480eb0ef4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.224266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c82cc79eb5542c189dd6d6480eb0ef4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.232149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c82cc79eb5542c189dd6d6480eb0ef4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.241188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c82cc79eb5542c189dd6d6480eb0ef4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.241962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c82cc79eb5542c189dd6d6480eb0ef4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.250142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1026/2039] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:20 2022] DELETE /identity/v3/users/1c82cc79eb5542c189dd6d6480eb0ef4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:20.254851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:20.255347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:20.255697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:20.278898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:20.280279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:20.346321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1014/2040] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:20.357046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:20.358571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:20.385660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:20.447188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f579-6acf-4edc-b823-d8acc141428b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:20.451011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:20.451675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:20.451960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:20.452242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:20.462150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:20.463750 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:20.474266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1027/2041] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:20.754972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:20.756418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:20.786398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37738ed-d0f3-42c2-a0b9-ea279acb6402 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:20.797806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:20.798727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:20.799012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:20.799296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] PATH_INFO: `/v3/projects/cab65fe8b16043a1bfc96b880ddda296` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:20.800500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab65fe8b16043a1bfc96b880ddda296)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:20.804506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:20.860871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab65fe8b16043a1bfc96b880ddda296', 'request_id': 'req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.871089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab65fe8b16043a1bfc96b880ddda296', 'request_id': 'req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.877887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab65fe8b16043a1bfc96b880ddda296', 'request_id': 'req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.896004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] The token cache is being invalidate because project cab65fe8b16043a1bfc96b880ddda296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:20.896298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.896968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:20.898604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1015/2042] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:20 2022] DELETE /identity/v3/projects/cab65fe8b16043a1bfc96b880ddda296 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:20.902989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:20.913659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa380d-5502-49bd-87dc-aae116408aa5 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:20.974722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:20.975612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:20.976863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:20.976981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] PATH_INFO: `/v3/users/22eafceda80a48b29e9da64346a1c734` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:20.978230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22eafceda80a48b29e9da64346a1c734)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:20.980188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:21.034341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22eafceda80a48b29e9da64346a1c734'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.047221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22eafceda80a48b29e9da64346a1c734'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.055171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22eafceda80a48b29e9da64346a1c734'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.062620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22eafceda80a48b29e9da64346a1c734'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.063245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-63e0b80e-c424-4933-94ae-732dd5dbe4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22eafceda80a48b29e9da64346a1c734'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.069470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1028/2043] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:20 2022] DELETE /identity/v3/users/22eafceda80a48b29e9da64346a1c734 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:21.382934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:21.384462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:21.409466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d0ae-a2cb-44f4-a88d-a1ef38398a26 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:21.509909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:21.511160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:21.511445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:21.511874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] PATH_INFO: `/v3/projects/35ca03896dbc4147abbba0ab69937fb6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:21.513108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ca03896dbc4147abbba0ab69937fb6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:21.515724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:21.526700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:21.595329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ca03896dbc4147abbba0ab69937fb6', 'request_id': 'req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.606914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ca03896dbc4147abbba0ab69937fb6', 'request_id': 'req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.615311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ca03896dbc4147abbba0ab69937fb6', 'request_id': 'req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.652402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] The token cache is being invalidate because project 35ca03896dbc4147abbba0ab69937fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:21.653019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.653825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c481ffe-6a22-42c0-bcaf-12ced94d5abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:21.655797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1016/2044] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:21 2022] DELETE /identity/v3/projects/35ca03896dbc4147abbba0ab69937fb6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:21.661764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1887-e200-42a9-9f15-90e8d60172f0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:21.662397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1887-e200-42a9-9f15-90e8d60172f0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:21.662890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1887-e200-42a9-9f15-90e8d60172f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:21.696055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d9ee1887-e200-42a9-9f15-90e8d60172f0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:21.698331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d9ee1887-e200-42a9-9f15-90e8d60172f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:21.767977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:21.793162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1029/2045] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:21.801214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e63c5-0163-447d-a752-1600fa235928 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:21.801524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e63c5-0163-447d-a752-1600fa235928 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:21.801841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e63c5-0163-447d-a752-1600fa235928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:21.822012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-661e63c5-0163-447d-a752-1600fa235928 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:21.823316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-661e63c5-0163-447d-a752-1600fa235928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:21.831681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1017/2046] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:21.836952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee1887-e200-42a9-9f15-90e8d60172f0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:21.847546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee1887-e200-42a9-9f15-90e8d60172f0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:21.852700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:21.853379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:21.853665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:21.854086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:21.854730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:21.855042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:21.856684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:21.868962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1030/2047] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:21.873632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e63c5-0163-447d-a752-1600fa235928 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:21.886193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e63c5-0163-447d-a752-1600fa235928 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:21.891069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:21.891750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:21.892037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:21.892317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:21.893022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:21.894991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:21.930775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1018/2048] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:21 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:15:21.932026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:21.942839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261ea9-c0ea-4a37-9d21-d43e8d685df4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.011378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.012108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.012404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.012685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.013414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.015429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.041151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1031/2049] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:21 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:22.046568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.058147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97807d-9615-4d3d-9f8d-3af44cdc184b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.065457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.066143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.066461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.066736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.067478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.069223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.080992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1019/2050] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:22.085021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.096840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaab35-eaaf-467c-b595-f82dd6834f8c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.103385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016e641-cdf1-4d11-8883-05df067d3362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.104069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e641-cdf1-4d11-8883-05df067d3362 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.104360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e641-cdf1-4d11-8883-05df067d3362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.104645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e641-cdf1-4d11-8883-05df067d3362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.105401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016e641-cdf1-4d11-8883-05df067d3362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.107056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016e641-cdf1-4d11-8883-05df067d3362 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.122248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1032/2051] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:22.127105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.138578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b9e5a-78d6-47af-bffd-4f3b81ab5df5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.150199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.151376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.152236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.152517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] PATH_INFO: `/v3/projects/2fe301d2b8674043884f51efb8ebd650/users/4b29cff3b7574e6a974ba8cb46429cf6/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.169967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe301d2b8674043884f51efb8ebd650, user_id=4b29cff3b7574e6a974ba8cb46429cf6, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.172819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.204318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1020/2052] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:22 2022] PUT /identity/v3/projects/2fe301d2b8674043884f51efb8ebd650/users/4b29cff3b7574e6a974ba8cb46429cf6/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:22.206091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b97ffb-4e17-48ca-be81-4f504c78d34d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.206418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b97ffb-4e17-48ca-be81-4f504c78d34d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.206713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b97ffb-4e17-48ca-be81-4f504c78d34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.240212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e9b97ffb-4e17-48ca-be81-4f504c78d34d None None] MFA Rules not processed for user `4b29cff3b7574e6a974ba8cb46429cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:22.242020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e9b97ffb-4e17-48ca-be81-4f504c78d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:22.330386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1033/2053] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:22.335188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.406435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbd192-fed3-4faf-9c56-2fbbd0dc2eba admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.411368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.412048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.412336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.412621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.413870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.415952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.444724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1021/2054] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:22 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:22.448913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b97ffb-4e17-48ca-be81-4f504c78d34d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.459837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b97ffb-4e17-48ca-be81-4f504c78d34d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.534300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:22.554750 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.555609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.555893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.556166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.556895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.559132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.580263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1034/2055] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:22 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:22.584417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.595008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d70bc4-1b66-4d0d-bed2-1e5f2be54b7d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.599743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.600415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.601218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.601494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.602524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.604128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.615323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1022/2056] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:22.619993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.630586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353aaa-f00b-4ec5-8b15-46abf6c994eb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.635673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.636351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.636637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.636912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.637648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.639414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.653451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1035/2057] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:22.654721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.662355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:22.669357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588a01-a534-433f-8338-4f8fc04f017b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.675909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28ffe7-09c8-4b9e-aec0-328a1094bc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.676789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28ffe7-09c8-4b9e-aec0-328a1094bc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.677062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28ffe7-09c8-4b9e-aec0-328a1094bc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.677344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28ffe7-09c8-4b9e-aec0-328a1094bc6b admin admin] PATH_INFO: `/v3/projects/2bf1f6707b2646958bc34b8e84175a49/users/a2d5e226ef104d2dab62e8a9cb4e5f59/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.696039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28ffe7-09c8-4b9e-aec0-328a1094bc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf1f6707b2646958bc34b8e84175a49, user_id=a2d5e226ef104d2dab62e8a9cb4e5f59, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.698771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28ffe7-09c8-4b9e-aec0-328a1094bc6b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.703802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.706013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:22.719236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1023/2058] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:22 2022] PUT /identity/v3/projects/2bf1f6707b2646958bc34b8e84175a49/users/a2d5e226ef104d2dab62e8a9cb4e5f59/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:22.720484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b70d-4fce-47e6-9147-a6d5ddaf803c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.731503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43646d7b-6153-490f-aa61-f2dcd0d913c7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.731790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43646d7b-6153-490f-aa61-f2dcd0d913c7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.736579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43646d7b-6153-490f-aa61-f2dcd0d913c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.763928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-43646d7b-6153-490f-aa61-f2dcd0d913c7 None None] MFA Rules not processed for user `a2d5e226ef104d2dab62e8a9cb4e5f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:22.776962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-43646d7b-6153-490f-aa61-f2dcd0d913c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:22.828231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.829281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.829647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.830066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] PATH_INFO: `/v3/users/890630c6ed4b42f787170163027c5f93` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.831473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=890630c6ed4b42f787170163027c5f93)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.833464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.894550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1024/2059] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:22.899500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43646d7b-6153-490f-aa61-f2dcd0d913c7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.910622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890630c6ed4b42f787170163027c5f93'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:22.912196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43646d7b-6153-490f-aa61-f2dcd0d913c7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:22.917681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:22.918599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.918859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.919149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.922202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:22.922202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:22.927183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890630c6ed4b42f787170163027c5f93'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:22.934195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890630c6ed4b42f787170163027c5f93'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:22.943115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890630c6ed4b42f787170163027c5f93'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:22.943927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac46d93-127a-4b3c-85f2-dcd3f5848e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890630c6ed4b42f787170163027c5f93'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:22.953514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1036/2060] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:22 2022] DELETE /identity/v3/users/890630c6ed4b42f787170163027c5f93 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:22.953696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1025/2061] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:22 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:22.956566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:22.956566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:22.956821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:22.959465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:22.962771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:22.982097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:22.983409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:23.026852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:23.058530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132b2a6-11f2-4bf6-83f4-3f33fd03c218 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.063176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1037/2062] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:23.063750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.063991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.064284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.064562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.065278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.067385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:23.073927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.075353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:23.094135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1026/2063] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:22 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:23.101881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.124785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b522f-93a1-4b15-a735-3579ed8a4697 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.136441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.139531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.141903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.142629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.145237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.148719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:23.160284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989f02-9e85-445e-a9f3-a7057ad9033b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.165304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.165989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.166338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.166638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.170251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1027/2064] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:23.173047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.179653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.181342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:23.186132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99417b1b-3626-4856-9c39-13b46708b6c4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.191333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.192667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.193018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.193361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] PATH_INFO: `/v3/projects/d2dde98ce4f04fec940e75ec3dba12e9/users/05b8873c413a4defad45e028bdbea5e5/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.197422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1038/2065] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:23.224201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dde98ce4f04fec940e75ec3dba12e9, user_id=05b8873c413a4defad45e028bdbea5e5, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.239577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:23.260481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1028/2066] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:23 2022] PUT /identity/v3/projects/d2dde98ce4f04fec940e75ec3dba12e9/users/05b8873c413a4defad45e028bdbea5e5/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:23.261272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.278582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532507-5874-42bd-8b9f-8d965187f459 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.409599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded42d7-e502-45ff-94e3-011c61fbade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.410742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded42d7-e502-45ff-94e3-011c61fbade8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.410933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded42d7-e502-45ff-94e3-011c61fbade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.411261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded42d7-e502-45ff-94e3-011c61fbade8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.412325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded42d7-e502-45ff-94e3-011c61fbade8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.415018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded42d7-e502-45ff-94e3-011c61fbade8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:23.428651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1039/2067] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:23.432830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.449470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:23.473501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c9ba4-4d34-45ac-8153-7205e8e502de admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.483802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.485060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.485552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.486050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] PATH_INFO: `/v3/projects/d2dde98ce4f04fec940e75ec3dba12e9/users/05b8873c413a4defad45e028bdbea5e5/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.489329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dde98ce4f04fec940e75ec3dba12e9, user_id=05b8873c413a4defad45e028bdbea5e5, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.494740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:23.510279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1029/2068] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:23 2022] PUT /identity/v3/projects/d2dde98ce4f04fec940e75ec3dba12e9/users/05b8873c413a4defad45e028bdbea5e5/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:23.520911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.521313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.521697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.560815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] MFA Rules not processed for user `05b8873c413a4defad45e028bdbea5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:23.562138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:23.654238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1040/2069] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:23.665341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.667519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:23.765773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffc069-ae8b-42ae-addc-80f4e4761bf7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.770036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.770961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.771245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.771593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.787280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.789519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:23.805054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1030/2070] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:23.886295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.888145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:23.894465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:23.896832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:23.905657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d0ee7-740b-4a46-8ccc-68db88e36f87 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.915124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.915756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.916050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.916379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.918283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:23.985484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f7ffc-ddb5-4041-b7ff-2368c7eed800 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:23.990389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:23.991333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:23.992108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:23.992384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] PATH_INFO: `/v3/projects/ad0dac0ddbad44a79513569c48a91677` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:23.993816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0dac0ddbad44a79513569c48a91677)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:23.995803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:24.027578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:24.029100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:24.044245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1031/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:24.048975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0dac0ddbad44a79513569c48a91677', 'request_id': 'req-112c9c62-c83a-4fa2-9086-506738a84cb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.058039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0dac0ddbad44a79513569c48a91677', 'request_id': 'req-112c9c62-c83a-4fa2-9086-506738a84cb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.064680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0dac0ddbad44a79513569c48a91677', 'request_id': 'req-112c9c62-c83a-4fa2-9086-506738a84cb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.085220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] The token cache is being invalidate because project ad0dac0ddbad44a79513569c48a91677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:24.085522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.086206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.088777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1041/2072] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:23 2022] DELETE /identity/v3/projects/ad0dac0ddbad44a79513569c48a91677 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:24.092628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:24.106449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23a23-7ee2-4777-9981-a033116e238e service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:24.188558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:24.189458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:24.189743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:24.190019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] PATH_INFO: `/v3/users/fc6ce7b0b522471ea98b9af096254d6a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:24.191431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6ce7b0b522471ea98b9af096254d6a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:24.193561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:24.279252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:24.310728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6ce7b0b522471ea98b9af096254d6a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.311575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6ce7b0b522471ea98b9af096254d6a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.329608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6ce7b0b522471ea98b9af096254d6a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.330518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6ce7b0b522471ea98b9af096254d6a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.341172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6ce7b0b522471ea98b9af096254d6a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.366344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1032/2073] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:24 2022] DELETE /identity/v3/users/fc6ce7b0b522471ea98b9af096254d6a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:24.711238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:24.712854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:24.733598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c9c62-c83a-4fa2-9086-506738a84cb4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:24.807229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:24.808106 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:24.808390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:24.808674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] PATH_INFO: `/v3/projects/07a88509a5e54ef2b6866bff300e20b8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:24.809886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a88509a5e54ef2b6866bff300e20b8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:24.811830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:24.854430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:24.866404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a88509a5e54ef2b6866bff300e20b8', 'request_id': 'req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.873941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a88509a5e54ef2b6866bff300e20b8', 'request_id': 'req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.881124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a88509a5e54ef2b6866bff300e20b8', 'request_id': 'req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.899271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] The token cache is being invalidate because project 07a88509a5e54ef2b6866bff300e20b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:24.899568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.900220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:24.901805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1042/2074] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:24 2022] DELETE /identity/v3/projects/07a88509a5e54ef2b6866bff300e20b8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:24.905901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:24.907396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:24.920463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26bb3e-79cc-4f31-be3d-98dde2cbb9ca admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:24.981407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:24.982382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:24.982709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:24.982989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] PATH_INFO: `/v3/users/7b9e5828b0fd4ce49c0b1eb9da598844` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:24.984966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9e5828b0fd4ce49c0b1eb9da598844)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:24.986890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:25.043956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9e5828b0fd4ce49c0b1eb9da598844'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.044677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9e5828b0fd4ce49c0b1eb9da598844'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.051798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9e5828b0fd4ce49c0b1eb9da598844'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.052471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9e5828b0fd4ce49c0b1eb9da598844'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.060784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6a3edac8-0139-46e4-8ace-5b9419737eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9e5828b0fd4ce49c0b1eb9da598844'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.078769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1033/2075] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:24 2022] DELETE /identity/v3/users/7b9e5828b0fd4ce49c0b1eb9da598844 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:25.360060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:25.362067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:25.377707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75bb26-5613-4f54-9cb6-a7e6d49a1158 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:25.452607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:25.454038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.454395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.454835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] PATH_INFO: `/v3/projects/5c725fbaaf064e2da4dc2e35d57f1b2c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.456133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c725fbaaf064e2da4dc2e35d57f1b2c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:25.458071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:25.515957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c725fbaaf064e2da4dc2e35d57f1b2c', 'request_id': 'req-788803d7-280f-492b-a3c0-df7db7d92a32'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.523969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c725fbaaf064e2da4dc2e35d57f1b2c', 'request_id': 'req-788803d7-280f-492b-a3c0-df7db7d92a32'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.530269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c725fbaaf064e2da4dc2e35d57f1b2c', 'request_id': 'req-788803d7-280f-492b-a3c0-df7db7d92a32'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.545379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] The token cache is being invalidate because project 5c725fbaaf064e2da4dc2e35d57f1b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:25.545677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.546368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-788803d7-280f-492b-a3c0-df7db7d92a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:25.549200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1043/2076] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:25 2022] DELETE /identity/v3/projects/5c725fbaaf064e2da4dc2e35d57f1b2c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:25.554728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c9d00-ffda-4b8c-8c87-c7740312c8a7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.555017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c9d00-ffda-4b8c-8c87-c7740312c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.555292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c9d00-ffda-4b8c-8c87-c7740312c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.580063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-db2c9d00-ffda-4b8c-8c87-c7740312c8a7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:25.581615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-db2c9d00-ffda-4b8c-8c87-c7740312c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:25.609058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:25.658867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1034/2077] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:25.664066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848edb64-546a-45e7-bc29-0c058f573c58 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.664372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848edb64-546a-45e7-bc29-0c058f573c58 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.664615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848edb64-546a-45e7-bc29-0c058f573c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.684605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-848edb64-546a-45e7-bc29-0c058f573c58 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:25.685851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-848edb64-546a-45e7-bc29-0c058f573c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:25.697537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1044/2078] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:25.702393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c9d00-ffda-4b8c-8c87-c7740312c8a7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:25.713524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c9d00-ffda-4b8c-8c87-c7740312c8a7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:25.719022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:25.719713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.720004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.720286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.721057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:25.721373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:25.723071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:25.740092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1035/2079] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:15:25.744805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848edb64-546a-45e7-bc29-0c058f573c58 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:25.754509 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848edb64-546a-45e7-bc29-0c058f573c58 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:25.759369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:25.760043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.760330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.760607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.761343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:25.763270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:25.795272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1045/2080] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:25 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:25.799581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:25.809891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b19253-541c-4ccf-b373-0f1c23872fb6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:25.881752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:25.882510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.882802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.883077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.883801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:25.885745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:25.915309 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1036/2081] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:25 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:25.919728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:25.930401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f75b39-530f-43f0-9dcf-2495f0958c89 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:25.935256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:25.935941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.936227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.936536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.937418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:25.939091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:25.951714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1046/2082] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:25.955919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:25.967247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6df03-91e6-487d-8821-e0fc0486a3a0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:25.974541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a1da-d660-43a1-9326-ff44565f41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:25.975262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a1da-d660-43a1-9326-ff44565f41fc admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:25.976231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a1da-d660-43a1-9326-ff44565f41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:25.976519 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a1da-d660-43a1-9326-ff44565f41fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:25.977536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17a1da-d660-43a1-9326-ff44565f41fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:25.979206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17a1da-d660-43a1-9326-ff44565f41fc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:25.990714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1037/2083] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:25.995094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:26.006133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fe182-1f77-4cb0-b9d8-e1c96c1898c8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:26.012307 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:26.013244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:26.013530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:26.013811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] PATH_INFO: `/v3/projects/973ccbb7e5024f5eb17d193252fa138f/users/f8187359089a436d805114f92c35c2e9/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:26.026875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:26.031563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973ccbb7e5024f5eb17d193252fa138f, user_id=f8187359089a436d805114f92c35c2e9, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:26.034327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:26.053931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1047/2084] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:25 2022] PUT /identity/v3/projects/973ccbb7e5024f5eb17d193252fa138f/users/f8187359089a436d805114f92c35c2e9/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:26.064565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:26.064855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:26.065168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:26.112527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] MFA Rules not processed for user `f8187359089a436d805114f92c35c2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:26.115311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:26.220156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1038/2085] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:26.232520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:26.234809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:26.312178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4822-e0d7-49d5-af0a-b2a8caf82a42 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:26.315909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22307af1-098c-4633-83b8-a4811096f965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:26.316616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22307af1-098c-4633-83b8-a4811096f965 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:26.316977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22307af1-098c-4633-83b8-a4811096f965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:26.317334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22307af1-098c-4633-83b8-a4811096f965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:26.327911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22307af1-098c-4633-83b8-a4811096f965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:26.329601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22307af1-098c-4633-83b8-a4811096f965 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:26.344871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1048/2086] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:27.129374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:27.130850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:27.159672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:27.198580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512d4b1-6ce9-4ea7-adc6-3dcde763f6b6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:27.203403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:27.204288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:27.204571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:27.204847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] PATH_INFO: `/v3/users/4b29cff3b7574e6a974ba8cb46429cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:27.206057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b29cff3b7574e6a974ba8cb46429cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:27.208077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:27.265192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b29cff3b7574e6a974ba8cb46429cf6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:27.266023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b29cff3b7574e6a974ba8cb46429cf6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:27.274036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b29cff3b7574e6a974ba8cb46429cf6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:27.274738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b29cff3b7574e6a974ba8cb46429cf6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:27.282862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b29cff3b7574e6a974ba8cb46429cf6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:27.300923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1039/2087] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:27 2022] DELETE /identity/v3/users/4b29cff3b7574e6a974ba8cb46429cf6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:27.305466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:27.305998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:27.306100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:27.324301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:27.325581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:27.394519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1049/2088] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:27.406940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:27.408443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:27.483939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0e80-3e65-40f4-85c6-33015047fc94 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:27.490311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:27.495693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:27.495693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:27.495693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:27.509378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:27.518120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:27.525872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1040/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:27.836316 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:27.840480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:27.902418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57dfc-55d8-4496-ae88-6d7fed88b70e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:27.911541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:27.913285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:27.913572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:27.913895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] PATH_INFO: `/v3/projects/2fe301d2b8674043884f51efb8ebd650` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:27.916442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe301d2b8674043884f51efb8ebd650)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:27.919034 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:28.037792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe301d2b8674043884f51efb8ebd650', 'request_id': 'req-490c7d74-2a75-420b-8700-d11006f447b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.053476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe301d2b8674043884f51efb8ebd650', 'request_id': 'req-490c7d74-2a75-420b-8700-d11006f447b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.060761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe301d2b8674043884f51efb8ebd650', 'request_id': 'req-490c7d74-2a75-420b-8700-d11006f447b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.083250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] The token cache is being invalidate because project 2fe301d2b8674043884f51efb8ebd650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:28.083593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.084241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.086846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1050/2090] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:27 2022] DELETE /identity/v3/projects/2fe301d2b8674043884f51efb8ebd650 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:28.091576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:28.103099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c3df-ccbc-4210-ad9b-4d32eb86bcda service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:28.192181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:28.215046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:28.216194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:28.216613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:28.216944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] PATH_INFO: `/v3/users/a2d5e226ef104d2dab62e8a9cb4e5f59` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:28.218369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d5e226ef104d2dab62e8a9cb4e5f59)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:28.223674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:28.289832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d5e226ef104d2dab62e8a9cb4e5f59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.290583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d5e226ef104d2dab62e8a9cb4e5f59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.298369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d5e226ef104d2dab62e8a9cb4e5f59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.299099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d5e226ef104d2dab62e8a9cb4e5f59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.313786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d5e226ef104d2dab62e8a9cb4e5f59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.332411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1041/2091] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:28 2022] DELETE /identity/v3/users/a2d5e226ef104d2dab62e8a9cb4e5f59 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:28.708043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:28.709641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:28.727626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7d74-2a75-420b-8700-d11006f447b8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:28.746577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:28.806754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:28.807618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:28.807899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:28.808169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] PATH_INFO: `/v3/projects/2bf1f6707b2646958bc34b8e84175a49` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:28.809406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf1f6707b2646958bc34b8e84175a49)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:28.811382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:28.865896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf1f6707b2646958bc34b8e84175a49', 'request_id': 'req-9c4ea9c8-61ec-431a-9cd5-519da9c96417'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.873463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf1f6707b2646958bc34b8e84175a49', 'request_id': 'req-9c4ea9c8-61ec-431a-9cd5-519da9c96417'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.881917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf1f6707b2646958bc34b8e84175a49', 'request_id': 'req-9c4ea9c8-61ec-431a-9cd5-519da9c96417'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.898136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] The token cache is being invalidate because project 2bf1f6707b2646958bc34b8e84175a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:28.898467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.899134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:28.900726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1051/2092] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:28 2022] DELETE /identity/v3/projects/2bf1f6707b2646958bc34b8e84175a49 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:28.904788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:28.906263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:28.920657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c87aa-16b1-46fb-889b-2d66114a48fc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:29.019277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:29.020295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.021163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.021163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] PATH_INFO: `/v3/users/05b8873c413a4defad45e028bdbea5e5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.022974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b8873c413a4defad45e028bdbea5e5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:29.025263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:29.106948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b8873c413a4defad45e028bdbea5e5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.107821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b8873c413a4defad45e028bdbea5e5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.116038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b8873c413a4defad45e028bdbea5e5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.116803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b8873c413a4defad45e028bdbea5e5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.124829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b8873c413a4defad45e028bdbea5e5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.148717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:29.183040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1042/2093] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:28 2022] DELETE /identity/v3/users/05b8873c413a4defad45e028bdbea5e5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:29.339364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:29.341816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:29.380234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea9c8-61ec-431a-9cd5-519da9c96417 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:29.495450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:29.496402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.496818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.497167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] PATH_INFO: `/v3/users/f8187359089a436d805114f92c35c2e9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.498478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8187359089a436d805114f92c35c2e9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:29.500455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:29.607506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8187359089a436d805114f92c35c2e9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.610496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:29.632355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:29.634097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:29.645928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8187359089a436d805114f92c35c2e9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.653188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1729b00-d4ec-4e56-b7dc-7328d8f75225 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:29.658428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:29.659451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.659807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.660197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] PATH_INFO: `/v3/projects/d2dde98ce4f04fec940e75ec3dba12e9` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.661772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2dde98ce4f04fec940e75ec3dba12e9)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:29.664499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:29.668228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8187359089a436d805114f92c35c2e9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.687188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8187359089a436d805114f92c35c2e9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.687850 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ad37b028-f4e4-4236-8eb4-51cd02797b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8187359089a436d805114f92c35c2e9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.696023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1052/2094] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:29 2022] DELETE /identity/v3/users/f8187359089a436d805114f92c35c2e9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:29.700853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.701136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.701445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.720904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:29.722228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:29.728152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2dde98ce4f04fec940e75ec3dba12e9', 'request_id': 'req-1ceada96-9011-4fdc-9ad1-55632fc65d74'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.740053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2dde98ce4f04fec940e75ec3dba12e9', 'request_id': 'req-1ceada96-9011-4fdc-9ad1-55632fc65d74'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.747870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2dde98ce4f04fec940e75ec3dba12e9', 'request_id': 'req-1ceada96-9011-4fdc-9ad1-55632fc65d74'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.760178 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] The token cache is being invalidate because project d2dde98ce4f04fec940e75ec3dba12e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:29.760479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.761150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ceada96-9011-4fdc-9ad1-55632fc65d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:29.762827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1043/2095] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:29 2022] DELETE /identity/v3/projects/d2dde98ce4f04fec940e75ec3dba12e9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:29.768937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aab109-63cf-4295-bfd2-5dbbfd9940c2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.769350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aab109-63cf-4295-bfd2-5dbbfd9940c2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.769763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aab109-63cf-4295-bfd2-5dbbfd9940c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.792995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-81aab109-63cf-4295-bfd2-5dbbfd9940c2 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:29.794329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-81aab109-63cf-4295-bfd2-5dbbfd9940c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:29.798047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1053/2096] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:29.802788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1044/2097] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:29.810949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:29.811985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973b79-1e82-4416-a659-f9f78fa27b6c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.812274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973b79-1e82-4416-a659-f9f78fa27b6c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.812385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:29.812546 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973b79-1e82-4416-a659-f9f78fa27b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.831184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8b973b79-1e82-4416-a659-f9f78fa27b6c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:29.832391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8b973b79-1e82-4416-a659-f9f78fa27b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:29.842832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1045/2098] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:29.847197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973b79-1e82-4416-a659-f9f78fa27b6c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:29.856712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973b79-1e82-4416-a659-f9f78fa27b6c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:29.861767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:29.862467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.862744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.863017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.863752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:29.864055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:29.865657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:29.879771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf19f29-f9b1-4193-abc8-8028f87db542 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:29.879953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1046/2099] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:29.884147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:29.885038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.885325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.885609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.886290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:29.895466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:29.896555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0914-9791-46d6-8504-27c63bd0260a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:29.896918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:29.905237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:29.906177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:29.906489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:29.906766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:29.907497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:29.908581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1054/2100] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:29.913616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:29.941791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1047/2101] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:29 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:29.946696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:29.957348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef58186-7022-4522-9165-66bb8b760a96 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.025882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.026864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.027222 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.027565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.028636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.031270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.048208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:30.055633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1055/2102] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:29 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:15:30.059474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.073572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee08c9-1463-44ec-ac63-7bf36f235020 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.079725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.080329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.083717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.083717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.083717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.083717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.097063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1048/2103] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:30.102246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.112635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e29d4-1c29-4e37-8812-e2bb95a755e7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.117569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab11361-be4e-47ff-be43-a4e5d30b8f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.118510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab11361-be4e-47ff-be43-a4e5d30b8f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.118935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab11361-be4e-47ff-be43-a4e5d30b8f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.119215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab11361-be4e-47ff-be43-a4e5d30b8f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.119971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab11361-be4e-47ff-be43-a4e5d30b8f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.121835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab11361-be4e-47ff-be43-a4e5d30b8f4b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.133630 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1056/2104] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:30.137847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.150348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5e26-ebd8-41e0-ade0-27185738a928 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.155197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.156098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.156381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.156654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] PATH_INFO: `/v3/projects/0f0b196d201e4521a40234de9880fe39/users/f083a2ef92ac4cb8978743cf97911a86/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.173222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0b196d201e4521a40234de9880fe39, user_id=f083a2ef92ac4cb8978743cf97911a86, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.176039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.191659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1049/2105] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:30 2022] PUT /identity/v3/projects/0f0b196d201e4521a40234de9880fe39/users/f083a2ef92ac4cb8978743cf97911a86/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:30.204010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b9e2-c8b6-4c87-ae2c-f26052bc2cba None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.204324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b9e2-c8b6-4c87-ae2c-f26052bc2cba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.204600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b9e2-c8b6-4c87-ae2c-f26052bc2cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.225471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.227598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:30.235258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1982b9e2-c8b6-4c87-ae2c-f26052bc2cba None None] MFA Rules not processed for user `f083a2ef92ac4cb8978743cf97911a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:30.236547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1982b9e2-c8b6-4c87-ae2c-f26052bc2cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:30.296117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:30.321168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1becf-ba53-4fa3-8e0e-2ae35bbf0cf9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.324829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1057/2106] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:30.325771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b9e2-c8b6-4c87-ae2c-f26052bc2cba None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.327866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.328706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.328984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.329251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] PATH_INFO: `/v3/projects/973ccbb7e5024f5eb17d193252fa138f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.330467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] RBAC: Authorizing `identity:delete_project(project_id=973ccbb7e5024f5eb17d193252fa138f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.332389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.342609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b9e2-c8b6-4c87-ae2c-f26052bc2cba None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.348113 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.348959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.349281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.349562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.350454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.352533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.384546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1058/2107] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:30.385698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.410333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973ccbb7e5024f5eb17d193252fa138f', 'request_id': 'req-958e3f07-f5fe-4036-b518-8c0c73c1693b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:30.422540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973ccbb7e5024f5eb17d193252fa138f', 'request_id': 'req-958e3f07-f5fe-4036-b518-8c0c73c1693b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:30.431436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973ccbb7e5024f5eb17d193252fa138f', 'request_id': 'req-958e3f07-f5fe-4036-b518-8c0c73c1693b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:30.447828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] The token cache is being invalidate because project 973ccbb7e5024f5eb17d193252fa138f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:30.448454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:30.449161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-958e3f07-f5fe-4036-b518-8c0c73c1693b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:30.451426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1050/2108] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:30 2022] DELETE /identity/v3/projects/973ccbb7e5024f5eb17d193252fa138f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:30.454312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fad020-3fba-4ce6-b3a7-86620c10b784 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.454312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fad020-3fba-4ce6-b3a7-86620c10b784 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.454593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fad020-3fba-4ce6-b3a7-86620c10b784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.474529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b2fad020-3fba-4ce6-b3a7-86620c10b784 None None] MFA Rules not processed for user `8c56cd1659d1439193221dfb93902ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:30.475767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b2fad020-3fba-4ce6-b3a7-86620c10b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:30.494119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875320-5bc5-42ee-b101-89a6108625bd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.500033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958e74-d963-41c1-947c-f36baae796b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.500865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958e74-d963-41c1-947c-f36baae796b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.501503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958e74-d963-41c1-947c-f36baae796b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.501613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958e74-d963-41c1-947c-f36baae796b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.502511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958e74-d963-41c1-947c-f36baae796b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.504460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958e74-d963-41c1-947c-f36baae796b3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.531437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1059/2109] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:30.532758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.533048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.533340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.556496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:30.557637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:30.566346 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1060/2110] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:30.567277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.568665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:30.580931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4542988-d6e0-4c51-94d0-f7cd59bd156c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.586832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.587597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.587938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.588138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.588833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.593356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1051/2111] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:30.593524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.593642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12136-c920-48a1-91a4-e662495db937 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.593642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12136-c920-48a1-91a4-e662495db937 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.593642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12136-c920-48a1-91a4-e662495db937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.611752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1061/2112] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:30.617151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.631310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f4e24-fd25-421a-991b-9ebdab4c54e3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.631897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f3b12136-c920-48a1-91a4-e662495db937 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:30.633131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f3b12136-c920-48a1-91a4-e662495db937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:30.640462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.641776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.642623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.642623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] PATH_INFO: `/v3/projects/a5b663c084944387b1d27386a37ced00/users/ffe6c8ef748141a49ce5ff6ed0568071/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.657032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1052/2113] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:30.661887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b12136-c920-48a1-91a4-e662495db937 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.673602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b663c084944387b1d27386a37ced00, user_id=ffe6c8ef748141a49ce5ff6ed0568071, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.676345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.678133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b12136-c920-48a1-91a4-e662495db937 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.690993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.693024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.693320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.693633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.694467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:30.694782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.699852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.701387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1062/2114] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:30 2022] PUT /identity/v3/projects/a5b663c084944387b1d27386a37ced00/users/ffe6c8ef748141a49ce5ff6ed0568071/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:30.702442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.711032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:30.735952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1053/2115] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:30.737820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.760504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b0630-b7c6-4c24-94e0-5b611f2fdf16 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.804963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b5f2b-448c-4096-b3fb-fa26b5b388fa admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.811949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.813918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.813918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.813918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.814893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.816857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.834801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1063/2116] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:30.837029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.852786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383474c0-2c6f-40c0-8cb6-33080c97b05f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:30.857590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929fb37-ecd6-4e9c-a5af-7a990ec6f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.858521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929fb37-ecd6-4e9c-a5af-7a990ec6f036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.858811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929fb37-ecd6-4e9c-a5af-7a990ec6f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.859090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929fb37-ecd6-4e9c-a5af-7a990ec6f036 admin admin] PATH_INFO: `/v3/projects/a5b663c084944387b1d27386a37ced00/users/ffe6c8ef748141a49ce5ff6ed0568071/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.860880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:30.862319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929fb37-ecd6-4e9c-a5af-7a990ec6f036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b663c084944387b1d27386a37ced00, user_id=ffe6c8ef748141a49ce5ff6ed0568071, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.862775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.863356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.863817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.864544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929fb37-ecd6-4e9c-a5af-7a990ec6f036 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.865373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:30.868976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:30.873859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:30.883995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1064/2117] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:30 2022] PUT /identity/v3/projects/a5b663c084944387b1d27386a37ced00/users/ffe6c8ef748141a49ce5ff6ed0568071/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:30.894377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217e17-5ac5-4978-8189-85901dc1dc93 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:30.894625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217e17-5ac5-4978-8189-85901dc1dc93 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:30.894871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217e17-5ac5-4978-8189-85901dc1dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:30.914235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1054/2118] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:30.917163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:30.926724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9f217e17-5ac5-4978-8189-85901dc1dc93 None None] MFA Rules not processed for user `ffe6c8ef748141a49ce5ff6ed0568071`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:30.927987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9f217e17-5ac5-4978-8189-85901dc1dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:30.997136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7906c-7494-4aa8-8f5e-e08643d580ec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:31.002640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:31.003504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.003792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.004071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.004827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:31.006895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:31.035868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1065/2119] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:31.041041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1055/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:30 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:15:31.042275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f217e17-5ac5-4978-8189-85901dc1dc93 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:31.049520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:31.053195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:31.057728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f217e17-5ac5-4978-8189-85901dc1dc93 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:31.063000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:31.064476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.064974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.065274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.066066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:31.068103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:31.082339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1066/2121] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:31.083615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:31.096097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d71cc-3e38-4e25-881f-5ecee3cf45fe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:31.103390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:31.104078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.104366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.104648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.106269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:31.108985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:31.126228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1067/2122] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:31.127274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:31.132489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38f11-a5cd-43c8-889b-0fd1dacc5968 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:31.140896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c936-2eae-4c08-b7e7-29e950928935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:31.141265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c936-2eae-4c08-b7e7-29e950928935 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.141265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c936-2eae-4c08-b7e7-29e950928935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.141810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c936-2eae-4c08-b7e7-29e950928935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.143087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36afb2-0e74-4331-8dd9-62270cff1aa4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:31.151024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:31.152516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.152516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.153039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] PATH_INFO: `/v3/projects/328b4193def54a6d9d64289979a889db/users/9160e720419f4034a1c0fae03664b51d/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.158699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48c936-2eae-4c08-b7e7-29e950928935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:31.160455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48c936-2eae-4c08-b7e7-29e950928935 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:31.172066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1056/2123] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:31.174003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=328b4193def54a6d9d64289979a889db, user_id=9160e720419f4034a1c0fae03664b51d, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:31.176798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:31.210351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1068/2124] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:31 2022] PUT /identity/v3/projects/328b4193def54a6d9d64289979a889db/users/9160e720419f4034a1c0fae03664b51d/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:31.213608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6a18-9858-4261-8bc1-74ed3316a336 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.213963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6a18-9858-4261-8bc1-74ed3316a336 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.214339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6a18-9858-4261-8bc1-74ed3316a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.255901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-328d6a18-9858-4261-8bc1-74ed3316a336 None None] MFA Rules not processed for user `9160e720419f4034a1c0fae03664b51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:31.257122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-328d6a18-9858-4261-8bc1-74ed3316a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:31.390114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1057/2125] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:31.403284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:31.405130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:31.472310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:31.585506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b3008-b0b7-41af-a81f-47808413eb4c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:31.589809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb5ab1-7684-4bd3-bdb9-b24a6e98e43a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164a361891274af1b20fe7b7458ecde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:31.590901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5ab1-7684-4bd3-bdb9-b24a6e98e43a service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.591262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5ab1-7684-4bd3-bdb9-b24a6e98e43a service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.591619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5ab1-7684-4bd3-bdb9-b24a6e98e43a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.602388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb5ab1-7684-4bd3-bdb9-b24a6e98e43a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:31.603867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb5ab1-7684-4bd3-bdb9-b24a6e98e43a service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:31.616155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1069/2126] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:31.785497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d6a18-9858-4261-8bc1-74ed3316a336 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:31.796788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:31.917155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d6a18-9858-4261-8bc1-74ed3316a336 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:31.924465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:31.925785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:31.926244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:31.926678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] PATH_INFO: `/v3/users/f083a2ef92ac4cb8978743cf97911a86` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:31.928128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] RBAC: Authorizing `identity:delete_user(user_id=f083a2ef92ac4cb8978743cf97911a86)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:31.932212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:32.002293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f083a2ef92ac4cb8978743cf97911a86'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:32.003331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f083a2ef92ac4cb8978743cf97911a86'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:32.013689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f083a2ef92ac4cb8978743cf97911a86'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:32.014569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f083a2ef92ac4cb8978743cf97911a86'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:32.026742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f083a2ef92ac4cb8978743cf97911a86'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:32.060844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1058/2127] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:31 2022] DELETE /identity/v3/users/f083a2ef92ac4cb8978743cf97911a86 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:32.066149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:32.067036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:32.067656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:32.119853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:32.123828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:32.218440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1070/2128] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:32.229842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:32.231716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:32.331227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269e012-a9f5-4004-a195-4190abe7c0de admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:32.335673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:32.336345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:32.336633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:32.336915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:32.354752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:32.357154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:32.402870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1059/2129] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:32.871639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:32.873373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:32.913837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ebaa0-c450-4cab-a04d-a34d429a8342 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:32.922135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:32.923723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:32.923911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:32.924188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] PATH_INFO: `/v3/projects/0f0b196d201e4521a40234de9880fe39` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:32.925462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0b196d201e4521a40234de9880fe39)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:32.927448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:33.007254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0b196d201e4521a40234de9880fe39', 'request_id': 'req-17f16e75-705b-4d0d-baf9-3397b20dd94b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.026482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0b196d201e4521a40234de9880fe39', 'request_id': 'req-17f16e75-705b-4d0d-baf9-3397b20dd94b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.040277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0b196d201e4521a40234de9880fe39', 'request_id': 'req-17f16e75-705b-4d0d-baf9-3397b20dd94b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.062055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] The token cache is being invalidate because project 0f0b196d201e4521a40234de9880fe39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:33.062406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.063945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.066279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1071/2130] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:32 2022] DELETE /identity/v3/projects/0f0b196d201e4521a40234de9880fe39 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:33.071020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:33.081637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53db3-ba4c-4348-9075-4728cc5fdd56 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:33.144645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:33.224102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:33.226526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:33.227247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:33.227691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] PATH_INFO: `/v3/users/ffe6c8ef748141a49ce5ff6ed0568071` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:33.230018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe6c8ef748141a49ce5ff6ed0568071)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:33.232108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:33.294337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe6c8ef748141a49ce5ff6ed0568071'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.295181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe6c8ef748141a49ce5ff6ed0568071'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.306620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe6c8ef748141a49ce5ff6ed0568071'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.307772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe6c8ef748141a49ce5ff6ed0568071'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.320339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d71a8ea-9a15-48d2-80f8-e18b64dfbffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe6c8ef748141a49ce5ff6ed0568071'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:33.365081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1060/2131] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:33 2022] DELETE /identity/v3/users/ffe6c8ef748141a49ce5ff6ed0568071 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:33.933968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:33.937060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:33.982025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f16e75-705b-4d0d-baf9-3397b20dd94b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:34.038366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:34.085829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:34.087496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.088009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.088482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] PATH_INFO: `/v3/projects/a5b663c084944387b1d27386a37ced00` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.094503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b663c084944387b1d27386a37ced00)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:34.096974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:34.159209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b663c084944387b1d27386a37ced00', 'request_id': 'req-8cf8244a-13f1-494d-b704-2d8f11943adf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:34.169705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b663c084944387b1d27386a37ced00', 'request_id': 'req-8cf8244a-13f1-494d-b704-2d8f11943adf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:34.173280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b663c084944387b1d27386a37ced00', 'request_id': 'req-8cf8244a-13f1-494d-b704-2d8f11943adf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:34.190213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] The token cache is being invalidate because project a5b663c084944387b1d27386a37ced00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:34.190213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:34.193544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cf8244a-13f1-494d-b704-2d8f11943adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:34.198242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1072/2132] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:33 2022] DELETE /identity/v3/projects/a5b663c084944387b1d27386a37ced00 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:34.203827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff80a-d16a-4aff-bfb2-9fa7f207eb70 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.203827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff80a-d16a-4aff-bfb2-9fa7f207eb70 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.203827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff80a-d16a-4aff-bfb2-9fa7f207eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.224128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d3aff80a-d16a-4aff-bfb2-9fa7f207eb70 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:34.225602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d3aff80a-d16a-4aff-bfb2-9fa7f207eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:34.354921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1061/2133] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:34.359925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada398d-1d2d-4fa9-b675-dea0cc299c2b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.360679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada398d-1d2d-4fa9-b675-dea0cc299c2b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.361339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada398d-1d2d-4fa9-b675-dea0cc299c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.386681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cada398d-1d2d-4fa9-b675-dea0cc299c2b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:34.388386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cada398d-1d2d-4fa9-b675-dea0cc299c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:34.402597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1073/2134] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:34.404314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff80a-d16a-4aff-bfb2-9fa7f207eb70 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:34.423113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff80a-d16a-4aff-bfb2-9fa7f207eb70 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:34.429597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:34.430389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.430682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.430964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.432837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:34.432837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:34.434619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:34.454209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1062/2135] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:34.456937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada398d-1d2d-4fa9-b675-dea0cc299c2b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:34.473262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada398d-1d2d-4fa9-b675-dea0cc299c2b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:34.480059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:34.481135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.482388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.482873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.484217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:34.489305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:34.549328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:34.559428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1074/2136] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:34 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:34.562279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ab882-3d75-42f6-903c-51e90e11a9aa admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:34.607288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:34.654577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:34.655278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.655565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.655842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.657023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:34.659228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:34.689001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1063/2137] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:34 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:34.692759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:34.715683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99731055-f6f0-4d83-9465-399982cb4e5a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:34.720909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:34.721751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.722140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.723625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.724323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:34.727053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:34.745599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1075/2138] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:34.747768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:34.762364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a85b-22c5-4164-a1fa-6ee9a4ea5383 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:34.767829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa807a-5949-41b8-936f-8e884f7559f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:34.768569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa807a-5949-41b8-936f-8e884f7559f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.768852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa807a-5949-41b8-936f-8e884f7559f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.769132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa807a-5949-41b8-936f-8e884f7559f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.769944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa807a-5949-41b8-936f-8e884f7559f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:34.773011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa807a-5949-41b8-936f-8e884f7559f9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:34.790296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1064/2139] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:34.793766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:34.809293 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb3e3-c1e5-4769-9171-6255ded0703a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:34.817019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:34.818288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.818817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.819588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] PATH_INFO: `/v3/projects/7b95b87b9b5a463b9002257a1ce94191/users/5c19aa86551a42ba8279d84c0c9f344b/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.838462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b95b87b9b5a463b9002257a1ce94191, user_id=5c19aa86551a42ba8279d84c0c9f344b, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:34.841522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:34.863521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1076/2140] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:34 2022] PUT /identity/v3/projects/7b95b87b9b5a463b9002257a1ce94191/users/5c19aa86551a42ba8279d84c0c9f344b/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:34.874478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7015-e7d2-4033-b990-a43247f8f0f4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:34.874858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7015-e7d2-4033-b990-a43247f8f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:34.875197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7015-e7d2-4033-b990-a43247f8f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:34.910394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-612c7015-e7d2-4033-b990-a43247f8f0f4 None None] MFA Rules not processed for user `5c19aa86551a42ba8279d84c0c9f344b`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:34.911695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-612c7015-e7d2-4033-b990-a43247f8f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:34.993053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1065/2141] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:34.997762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:35.095986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:35.107640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0662-bc3e-4972-8c3b-db827890a15b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:35.115119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:35.116790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:35.117281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:35.117573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:35.118345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:35.120286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:35.168355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1077/2142] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:34 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:35.169912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c7015-e7d2-4033-b990-a43247f8f0f4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:35.190725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c7015-e7d2-4033-b990-a43247f8f0f4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:35.277259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:35.277962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:35.278275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:35.278555 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:35.279272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:35.281259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:35.307106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1066/2143] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:35 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:35.310993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:35.323638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd981-e991-446a-b084-a60fed227aa9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:35.330707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:35.334359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:35.335324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:35.335833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:35.336749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:35.338682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:35.359477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1078/2144] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:35.363411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:35.378495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce521f82-4dce-4c06-af76-732b4ff5f94b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:35.398209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a022ce6-06b3-48c9-bdb2-958754134e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:35.398500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a022ce6-06b3-48c9-bdb2-958754134e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:35.399718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a022ce6-06b3-48c9-bdb2-958754134e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:35.399718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a022ce6-06b3-48c9-bdb2-958754134e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:35.400592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a022ce6-06b3-48c9-bdb2-958754134e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:35.402322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a022ce6-06b3-48c9-bdb2-958754134e4d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:35.418713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1067/2145] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:35.419838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:35.431309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f53972-3efd-4ed0-97a9-bfc05889335a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:35.436731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:35.438673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:35.438673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:35.438673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] PATH_INFO: `/v3/projects/7737f83c213b4b7eb5c7bd60eb5e7333/users/455981f9cf344c8ba8215544e715c6f8/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:35.468157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7737f83c213b4b7eb5c7bd60eb5e7333, user_id=455981f9cf344c8ba8215544e715c6f8, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:35.471499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:35.492078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1079/2146] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:35 2022] PUT /identity/v3/projects/7737f83c213b4b7eb5c7bd60eb5e7333/users/455981f9cf344c8ba8215544e715c6f8/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:35.567939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b08b2-fff6-4f5f-a1ac-5aa92fcb6ad1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:35.568157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b08b2-fff6-4f5f-a1ac-5aa92fcb6ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:35.568440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b08b2-fff6-4f5f-a1ac-5aa92fcb6ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:35.607122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5c2b08b2-fff6-4f5f-a1ac-5aa92fcb6ad1 None None] MFA Rules not processed for user `455981f9cf344c8ba8215544e715c6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:35.608369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5c2b08b2-fff6-4f5f-a1ac-5aa92fcb6ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:35.620014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:35.705018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1068/2147] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:35.710330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:35.808706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a75e22-4962-4a23-b413-fe274de3a57f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:35.817390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:35.817907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:35.818340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:35.818502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:35.819219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:35.827642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:35.908425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1080/2148] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:35 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:35.913730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b08b2-fff6-4f5f-a1ac-5aa92fcb6ad1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:35.939641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b08b2-fff6-4f5f-a1ac-5aa92fcb6ad1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:36.052476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:36.052476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:36.052476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:36.053021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:36.054485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:36.056648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:36.084156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1069/2149] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:35 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:36.089747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:36.102559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0f781-88b4-4d37-a78e-8de8f1926dba admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:36.108893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:36.119166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:36.119551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:36.120020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:36.120865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:36.122982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:36.137129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1081/2150] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:36.143593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:36.157510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c976f-f714-4e34-8302-15d3f0b561e9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:36.164217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:36.165314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:36.166079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:36.166079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] PATH_INFO: `/v3/projects/067de8dcd3184e33ae850768433fe6e3/users/36c4b47d5c0f4010b7da3005ab697084/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:36.214220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067de8dcd3184e33ae850768433fe6e3, user_id=36c4b47d5c0f4010b7da3005ab697084, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:36.217728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:36.247819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1070/2151] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:36 2022] PUT /identity/v3/projects/067de8dcd3184e33ae850768433fe6e3/users/36c4b47d5c0f4010b7da3005ab697084/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:36.249055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:36.264265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d5b5d-9f9b-41ed-8693-d6572c4ddf30 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:36.394686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e3729-da3d-4746-aafa-deb83d524406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:36.395788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e3729-da3d-4746-aafa-deb83d524406 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:36.398641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e3729-da3d-4746-aafa-deb83d524406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:36.398641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e3729-da3d-4746-aafa-deb83d524406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:36.398641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e3729-da3d-4746-aafa-deb83d524406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:36.400005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e3729-da3d-4746-aafa-deb83d524406 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:36.416853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1082/2152] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:36.417733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:36.431545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c17fa0-99fd-49d7-a028-6c63caffd4a0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:36.436507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:36.437543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:36.438139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:36.438510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] PATH_INFO: `/v3/projects/067de8dcd3184e33ae850768433fe6e3/users/36c4b47d5c0f4010b7da3005ab697084/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:36.440910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067de8dcd3184e33ae850768433fe6e3, user_id=36c4b47d5c0f4010b7da3005ab697084, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:36.446719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:36.466134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1071/2153] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:36 2022] PUT /identity/v3/projects/067de8dcd3184e33ae850768433fe6e3/users/36c4b47d5c0f4010b7da3005ab697084/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:36.476415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:36.476985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:36.477269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:36.529852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] MFA Rules not processed for user `36c4b47d5c0f4010b7da3005ab697084`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:36.531376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:36.544186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:36.731548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1083/2154] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:36.731789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:36.732963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:36.862318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70983bc4-999d-4678-9edf-405d4c8566c0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:36.884523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:36.885213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:36.885503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:36.891230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:36.945580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:37.023723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:37.025338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:37.063557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:37.065859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:37.090913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1072/2155] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:37.156397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a01b66-dcd6-4f29-ba75-d9f09d3922a3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:37.161744 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:37.163212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:37.163500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:37.163779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] PATH_INFO: `/v3/users/f1274aeb006048b790ab41824d999485` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:37.165329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1274aeb006048b790ab41824d999485)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:37.171190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:37.243955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1274aeb006048b790ab41824d999485'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.263955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1274aeb006048b790ab41824d999485'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.271902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1274aeb006048b790ab41824d999485'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.281626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1274aeb006048b790ab41824d999485'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.282398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d07761df-e7a9-4851-a701-ab2f783551a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1274aeb006048b790ab41824d999485'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.294372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1084/2156] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:37 2022] DELETE /identity/v3/users/f1274aeb006048b790ab41824d999485 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:37.516417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:37.528815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e805d7a-e69f-4712-8124-55ce40ed24d0 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:37.592373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:37.593248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:37.593527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:37.593800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] PATH_INFO: `/v3/projects/5626a7c1c51d439480179a9c2c5555bd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:37.595162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5626a7c1c51d439480179a9c2c5555bd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:37.597082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:37.644931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5626a7c1c51d439480179a9c2c5555bd', 'request_id': 'req-c4a797d6-c515-4df8-9b52-75d9404da166'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.652999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5626a7c1c51d439480179a9c2c5555bd', 'request_id': 'req-c4a797d6-c515-4df8-9b52-75d9404da166'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.658818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5626a7c1c51d439480179a9c2c5555bd', 'request_id': 'req-c4a797d6-c515-4df8-9b52-75d9404da166'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.671937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] The token cache is being invalidate because project 5626a7c1c51d439480179a9c2c5555bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:37.672225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.672948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4a797d6-c515-4df8-9b52-75d9404da166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:37.674738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1073/2157] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:37 2022] DELETE /identity/v3/projects/5626a7c1c51d439480179a9c2c5555bd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:37.680410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bda73-9dd0-4e7d-9c06-b77d65d10e08 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:37.680833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bda73-9dd0-4e7d-9c06-b77d65d10e08 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:37.681209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bda73-9dd0-4e7d-9c06-b77d65d10e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:37.699798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0b8bda73-9dd0-4e7d-9c06-b77d65d10e08 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:37.700999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0b8bda73-9dd0-4e7d-9c06-b77d65d10e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:37.719098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:37.767611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1085/2158] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:37.776109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc494cd-2ea0-4e27-afeb-90e41ea07c59 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:37.776482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc494cd-2ea0-4e27-afeb-90e41ea07c59 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:37.776854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc494cd-2ea0-4e27-afeb-90e41ea07c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:37.811098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dfc494cd-2ea0-4e27-afeb-90e41ea07c59 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:37.812340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dfc494cd-2ea0-4e27-afeb-90e41ea07c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:37.822995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1074/2159] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:37.827382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bda73-9dd0-4e7d-9c06-b77d65d10e08 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:37.839690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bda73-9dd0-4e7d-9c06-b77d65d10e08 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:37.846842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:37.847534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:37.847824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:37.848109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:37.849283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:37.849283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:37.851901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:37.864448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1086/2160] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:37.868912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc494cd-2ea0-4e27-afeb-90e41ea07c59 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:37.878539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc494cd-2ea0-4e27-afeb-90e41ea07c59 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:37.883341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:37.884009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:37.884298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:37.884579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:37.885288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:37.887470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:37.918116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1075/2161] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:37 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:37.922213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:37.932524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb6dc1-61ee-40fa-9a52-a1723f0af752 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:37.992528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:37.993220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:37.993507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:37.993786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:37.994626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:37.996561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.019959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1087/2162] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:37 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:38.021148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.032299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae60dd-fd9c-40be-9a91-5ddef0c2cc2a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.037487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.039020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.039388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.039797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.040820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.042711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.054591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1076/2163] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:38.058663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.068799 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41068e-0b17-4e0f-beeb-01758743f3a1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.073956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17d99c-3d47-4b26-8050-1f3ae3fb1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.074658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d99c-3d47-4b26-8050-1f3ae3fb1f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.074941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d99c-3d47-4b26-8050-1f3ae3fb1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.075218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d99c-3d47-4b26-8050-1f3ae3fb1f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.075949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17d99c-3d47-4b26-8050-1f3ae3fb1f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.077580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17d99c-3d47-4b26-8050-1f3ae3fb1f8a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.088715 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1088/2164] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:38.093551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.104684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bbe1-edd1-4b35-a6b3-96363f9756ec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.109396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.110522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.110811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.111092 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] PATH_INFO: `/v3/projects/c75d84afa1e649fd93b9db144977e387/users/2d753c2609874ab9834f49e69d8c580a/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.114429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:38.128214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75d84afa1e649fd93b9db144977e387, user_id=2d753c2609874ab9834f49e69d8c580a, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.131214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.148599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1077/2165] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:38 2022] PUT /identity/v3/projects/c75d84afa1e649fd93b9db144977e387/users/2d753c2609874ab9834f49e69d8c580a/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:38.158870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc15c2-d141-46c4-9464-2a5f384370e3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.159396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc15c2-d141-46c4-9464-2a5f384370e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.159396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc15c2-d141-46c4-9464-2a5f384370e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.188917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2bfc15c2-d141-46c4-9464-2a5f384370e3 None None] MFA Rules not processed for user `2d753c2609874ab9834f49e69d8c580a`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:38.190135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2bfc15c2-d141-46c4-9464-2a5f384370e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:38.273344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1089/2166] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:38.276069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.354619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083f00e-ed52-42ec-8354-4c76b87f3185 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.359530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.360293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.360652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.361030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.361820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.363935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.398002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1078/2167] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:38 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:38.399624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc15c2-d141-46c4-9464-2a5f384370e3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.425208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc15c2-d141-46c4-9464-2a5f384370e3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.439196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:38.498450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.499003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.499296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.499577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.500295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.502432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.531715 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1090/2168] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:38 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:38.536773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.551721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48e607-e520-4669-b391-844bf1a7e0f6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.557149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.558191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.558491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.558771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.559607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.561415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.574316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1079/2169] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:15:38.579105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.590077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf8a2-31fe-4d64-9564-ac530156136a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.603803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.605351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.605886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.606211 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] PATH_INFO: `/v3/projects/85745d389327461b979960c6611b69fa/users/c1432d9ec6264ba5865fa0d7e9250a35/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.625962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85745d389327461b979960c6611b69fa, user_id=c1432d9ec6264ba5865fa0d7e9250a35, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.628755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.648909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1091/2170] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:38 2022] PUT /identity/v3/projects/85745d389327461b979960c6611b69fa/users/c1432d9ec6264ba5865fa0d7e9250a35/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:38.652924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.663471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8b9b-132a-4f17-b9b0-fa9dace51450 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.678845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.680678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:38.737670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.738216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.738510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.738785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.739530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.741645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.742154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd81d4-5d56-417b-8c2b-68cb569255c8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.745956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.746655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.746943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.747234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.749454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:38.752636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1080/2171] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:38.757667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.768641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129bdbd-85e5-4f55-9cfe-a91e92a8a6fb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:38.779349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a3f3-51de-4895-b45e-82eaa86c58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:38.780260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a3f3-51de-4895-b45e-82eaa86c58b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.780544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a3f3-51de-4895-b45e-82eaa86c58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.780817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a3f3-51de-4895-b45e-82eaa86c58b2 admin admin] PATH_INFO: `/v3/projects/85745d389327461b979960c6611b69fa/users/c1432d9ec6264ba5865fa0d7e9250a35/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.782895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129a3f3-51de-4895-b45e-82eaa86c58b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85745d389327461b979960c6611b69fa, user_id=c1432d9ec6264ba5865fa0d7e9250a35, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.785573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129a3f3-51de-4895-b45e-82eaa86c58b2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.799192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1081/2172] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:38 2022] PUT /identity/v3/projects/85745d389327461b979960c6611b69fa/users/c1432d9ec6264ba5865fa0d7e9250a35/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:38.811791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd67fc-cc4c-454f-aa6a-e55e72e7f7c6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:38.812082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd67fc-cc4c-454f-aa6a-e55e72e7f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:38.812365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd67fc-cc4c-454f-aa6a-e55e72e7f7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:38.817541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:38.817541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:38.829653 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1092/2173] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:15:38.844204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9bbd67fc-cc4c-454f-aa6a-e55e72e7f7c6 None None] MFA Rules not processed for user `c1432d9ec6264ba5865fa0d7e9250a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:38.845478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9bbd67fc-cc4c-454f-aa6a-e55e72e7f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:38.894412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:38.945390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1082/2174] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:38.960540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:38.968141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:38.980885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81e5cc-11b5-4a47-ad57-5db06a61ed72 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:39.020810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:39.041267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:39.042046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:39.042420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:39.042728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:39.058223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:39.060632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:39.077730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1093/2175] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:39.160304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd67fc-cc4c-454f-aa6a-e55e72e7f7c6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:39.171148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd67fc-cc4c-454f-aa6a-e55e72e7f7c6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:39.174866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:39.175566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:39.175847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:39.176097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:39.269946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:39.271855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:39.282927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1083/2176] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:39.503970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:39.513126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55aa6-c447-4bef-ac83-5da8af514401 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:39.516933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074145e2-31de-40df-8cc0-1ba8eba840c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:39.517599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074145e2-31de-40df-8cc0-1ba8eba840c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:39.517889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074145e2-31de-40df-8cc0-1ba8eba840c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:39.518201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074145e2-31de-40df-8cc0-1ba8eba840c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:39.520244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-074145e2-31de-40df-8cc0-1ba8eba840c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:39.616873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074145e2-31de-40df-8cc0-1ba8eba840c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:39.618368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074145e2-31de-40df-8cc0-1ba8eba840c6 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:39.630073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1094/2177] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:49.278245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=43 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:49.625221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=39 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:50.084809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:50.086390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:50.177459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13e6d7-3433-43fb-b6d9-d811cab3d36e service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:50.182043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:50.182988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:50.183276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:50.183549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] PATH_INFO: `/v3/users/5c19aa86551a42ba8279d84c0c9f344b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:50.184861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c19aa86551a42ba8279d84c0c9f344b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:50.187729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:50.274004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c19aa86551a42ba8279d84c0c9f344b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:50.274645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c19aa86551a42ba8279d84c0c9f344b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:50.306134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c19aa86551a42ba8279d84c0c9f344b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:50.308330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c19aa86551a42ba8279d84c0c9f344b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:50.322157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c19aa86551a42ba8279d84c0c9f344b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:50.353267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1084/2178] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:50 2022] DELETE /identity/v3/users/5c19aa86551a42ba8279d84c0c9f344b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:50.357626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:50.358583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:50.358941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:50.382423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:50.383988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:50.465495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1095/2179] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:50.477611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:50.479585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:50.548915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e1dff-29a3-4bc4-8cf5-070f5e0dc739 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:50.552650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:50.553819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:50.554074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:50.554485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:50.565638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:50.567135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:50.578119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1085/2180] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:50.869367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:50.870875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:50.894501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d8a5-af18-43cf-bcb8-8917966b68cd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:50.900590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:50.901471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:50.901762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:50.902043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] PATH_INFO: `/v3/projects/7b95b87b9b5a463b9002257a1ce94191` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:50.903333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b95b87b9b5a463b9002257a1ce94191)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:50.905272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:50.973582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b95b87b9b5a463b9002257a1ce94191', 'request_id': 'req-acdd2be7-dc9a-448b-a9ee-9a4330671216'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:50.981416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b95b87b9b5a463b9002257a1ce94191', 'request_id': 'req-acdd2be7-dc9a-448b-a9ee-9a4330671216'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:50.987792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b95b87b9b5a463b9002257a1ce94191', 'request_id': 'req-acdd2be7-dc9a-448b-a9ee-9a4330671216'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.002972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] The token cache is being invalidate because project 7b95b87b9b5a463b9002257a1ce94191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:51.003262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.003993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.005848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1096/2181] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:50 2022] DELETE /identity/v3/projects/7b95b87b9b5a463b9002257a1ce94191 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:51.010922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:51.021590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282da5d-5fc1-4b4d-a799-336f6cdff50f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:51.050138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:51.103897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:51.105056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:51.105425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:51.105703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] PATH_INFO: `/v3/users/455981f9cf344c8ba8215544e715c6f8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:51.107045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455981f9cf344c8ba8215544e715c6f8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:51.109434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:51.169783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455981f9cf344c8ba8215544e715c6f8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.170483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455981f9cf344c8ba8215544e715c6f8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.177991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455981f9cf344c8ba8215544e715c6f8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.178764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455981f9cf344c8ba8215544e715c6f8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.189152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455981f9cf344c8ba8215544e715c6f8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.210693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1086/2182] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:51 2022] DELETE /identity/v3/users/455981f9cf344c8ba8215544e715c6f8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:51.536791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:51.539445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:51.555340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd2be7-dc9a-448b-a9ee-9a4330671216 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:51.623151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:51.624032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:51.624314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:51.624590 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] PATH_INFO: `/v3/projects/7737f83c213b4b7eb5c7bd60eb5e7333` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:51.625812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7737f83c213b4b7eb5c7bd60eb5e7333)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:51.627819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:51.663508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:51.681930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7737f83c213b4b7eb5c7bd60eb5e7333', 'request_id': 'req-f8da426a-77be-4efa-b74c-727febd6ef23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.688481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7737f83c213b4b7eb5c7bd60eb5e7333', 'request_id': 'req-f8da426a-77be-4efa-b74c-727febd6ef23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.697020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7737f83c213b4b7eb5c7bd60eb5e7333', 'request_id': 'req-f8da426a-77be-4efa-b74c-727febd6ef23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.715062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] The token cache is being invalidate because project 7737f83c213b4b7eb5c7bd60eb5e7333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:51.715332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.715967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.717528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1097/2183] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:51 2022] DELETE /identity/v3/projects/7737f83c213b4b7eb5c7bd60eb5e7333 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:51.722071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:51.724229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:51.739554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe60fc-eaa8-497f-8751-9c47178dac13 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:51.802574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:51.803605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:51.803889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:51.804163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] PATH_INFO: `/v3/users/36c4b47d5c0f4010b7da3005ab697084` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:51.805424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c4b47d5c0f4010b7da3005ab697084)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:51.807339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:51.858252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:51.861533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c4b47d5c0f4010b7da3005ab697084'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.862783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c4b47d5c0f4010b7da3005ab697084'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.872065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c4b47d5c0f4010b7da3005ab697084'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.872635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c4b47d5c0f4010b7da3005ab697084'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.880612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9460222d-ee85-4f1e-a3d9-f42563ec00a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c4b47d5c0f4010b7da3005ab697084'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:51.900014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1087/2184] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:51 2022] DELETE /identity/v3/users/36c4b47d5c0f4010b7da3005ab697084 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:52.182543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.184367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:52.198392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da426a-77be-4efa-b74c-727febd6ef23 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:52.258312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:52.259189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.259471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.259756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] PATH_INFO: `/v3/projects/067de8dcd3184e33ae850768433fe6e3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.260976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067de8dcd3184e33ae850768433fe6e3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:52.262926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:52.309946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067de8dcd3184e33ae850768433fe6e3', 'request_id': 'req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:52.315965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067de8dcd3184e33ae850768433fe6e3', 'request_id': 'req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:52.321402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067de8dcd3184e33ae850768433fe6e3', 'request_id': 'req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:52.334162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] The token cache is being invalidate because project 067de8dcd3184e33ae850768433fe6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:52.334478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:52.335104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a8f20db9-f6a3-4aab-a7f1-d6d673770e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:52.336655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1098/2185] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:52 2022] DELETE /identity/v3/projects/067de8dcd3184e33ae850768433fe6e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:52.341656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86e64-2697-4a88-826a-e310ef570ed6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.341952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86e64-2697-4a88-826a-e310ef570ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.342295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86e64-2697-4a88-826a-e310ef570ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.365264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d0b86e64-2697-4a88-826a-e310ef570ed6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:52.366993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d0b86e64-2697-4a88-826a-e310ef570ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:52.435652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1088/2186] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:52.444247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b6044-951e-445e-a381-80b46118ebe4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.444669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b6044-951e-445e-a381-80b46118ebe4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.444846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b6044-951e-445e-a381-80b46118ebe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.467962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-892b6044-951e-445e-a381-80b46118ebe4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:52.469321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-892b6044-951e-445e-a381-80b46118ebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:52.486257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1099/2187] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:52.491567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b86e64-2697-4a88-826a-e310ef570ed6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.504772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b86e64-2697-4a88-826a-e310ef570ed6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:52.511567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:52.511901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.512182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.512459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.513362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:52.513705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:52.515397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:52.534162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1089/2188] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:52.535535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b6044-951e-445e-a381-80b46118ebe4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.546084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b6044-951e-445e-a381-80b46118ebe4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:52.554512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:52.556191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.556191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.556191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.557308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:52.559323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:52.597510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1100/2189] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:52 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:15:52.604032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.616861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9236-d8e7-42e6-a6d5-64a5a7a81171 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:52.692946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:52.693658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.693944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.694251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.694972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:52.697472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:52.721439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1090/2190] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:52 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:52.726098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.741778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79b4e-75f3-4324-bac2-05cda32f4a61 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:52.752772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:52.753475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.753759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.754041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.754824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:52.756490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:52.767942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1101/2191] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:52.772728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.783874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490a4c8-7aed-475d-b58c-ff0f1aa2f575 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:52.791269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d622-446e-4c9f-a6d6-73cb842a02e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:52.792041 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d622-446e-4c9f-a6d6-73cb842a02e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.792336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d622-446e-4c9f-a6d6-73cb842a02e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.792622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d622-446e-4c9f-a6d6-73cb842a02e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.793401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d622-446e-4c9f-a6d6-73cb842a02e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:52.795086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d622-446e-4c9f-a6d6-73cb842a02e5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:52.816886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1091/2192] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:52.821562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.824635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:52.830350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1c1f-e001-4322-ae8d-857af7e40a79 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:52.838422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:52.839340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.839893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.840326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] PATH_INFO: `/v3/projects/134431b6758149c0a22426b97ba1b9da/users/1184a6a19fa242ae973bf635b56b1f7c/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.860899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134431b6758149c0a22426b97ba1b9da, user_id=1184a6a19fa242ae973bf635b56b1f7c, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:52.863674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:52.878829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1102/2193] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:52 2022] PUT /identity/v3/projects/134431b6758149c0a22426b97ba1b9da/users/1184a6a19fa242ae973bf635b56b1f7c/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:52.883893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2fd4-9d05-4804-a10e-83e617d212b6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:52.884192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2fd4-9d05-4804-a10e-83e617d212b6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:52.884470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2fd4-9d05-4804-a10e-83e617d212b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:52.903470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b67d2fd4-9d05-4804-a10e-83e617d212b6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:52.904821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b67d2fd4-9d05-4804-a10e-83e617d212b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:52.929320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:52.980469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1092/2194] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:52.990340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:52.993809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:53.075040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84d3fd-87b9-4562-9dbf-8ece09982377 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:53.078729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:53.079383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:53.079670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:53.079950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:53.090201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:53.091652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:53.101595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1103/2195] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:53.997417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:53.997875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:53.998072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:54.059189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] MFA Rules not processed for user `1184a6a19fa242ae973bf635b56b1f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:54.060455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:54.182936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1093/2196] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:54.248121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:54.250591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:54.359250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:54.361885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:54.413600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d64a0-3eee-4a63-ab02-8a36d7b7f482 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:54.416873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f284ff-0723-4b36-97c8-1b1cbcc4fa23 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:54.422898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eff63-e0c8-46ea-b9cb-875354b89553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:54.425051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eff63-e0c8-46ea-b9cb-875354b89553 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:54.425812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eff63-e0c8-46ea-b9cb-875354b89553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:54.426522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eff63-e0c8-46ea-b9cb-875354b89553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:54.432615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:54.437241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:54.437580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:54.437872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] PATH_INFO: `/v3/users/2d753c2609874ab9834f49e69d8c580a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:54.460465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d753c2609874ab9834f49e69d8c580a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:54.462774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:54.465532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eff63-e0c8-46ea-b9cb-875354b89553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:54.496045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eff63-e0c8-46ea-b9cb-875354b89553 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:54.519784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1104/2197] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:54.568445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d753c2609874ab9834f49e69d8c580a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:54.569497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d753c2609874ab9834f49e69d8c580a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:54.579295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d753c2609874ab9834f49e69d8c580a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:54.580223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d753c2609874ab9834f49e69d8c580a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:54.591616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d753c2609874ab9834f49e69d8c580a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:54.613908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1094/2198] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:54 2022] DELETE /identity/v3/users/2d753c2609874ab9834f49e69d8c580a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:54.619022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:54.619317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:54.619604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:54.641308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:54.642575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:54.727780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1105/2199] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:54.739159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:54.742011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:54.870386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:54.922321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c5e6e-b379-47e2-92a0-412e59069c29 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:54.928565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:54.929351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:54.929696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:54.931033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:54.952336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:54.952336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:54.971475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1095/2200] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:55.284582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:55.286131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:55.310047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e77c2a-6297-462b-8942-6fe7aa62f8dd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:55.325561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:55.326493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:55.326781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:55.327062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] PATH_INFO: `/v3/projects/c75d84afa1e649fd93b9db144977e387` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:55.330632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75d84afa1e649fd93b9db144977e387)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:55.330632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:55.354719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:55.380061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75d84afa1e649fd93b9db144977e387', 'request_id': 'req-c95e9917-491f-4338-8cf1-77d31b0fb6ef'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.387132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75d84afa1e649fd93b9db144977e387', 'request_id': 'req-c95e9917-491f-4338-8cf1-77d31b0fb6ef'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.393355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75d84afa1e649fd93b9db144977e387', 'request_id': 'req-c95e9917-491f-4338-8cf1-77d31b0fb6ef'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.407527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] The token cache is being invalidate because project c75d84afa1e649fd93b9db144977e387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:55.407815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.408512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.410131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1106/2201] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:55 2022] DELETE /identity/v3/projects/c75d84afa1e649fd93b9db144977e387 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:55.414379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:55.424218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143cb64-8c4b-46fc-8f52-2241afd69177 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:55.486341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:55.487220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:55.487502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:55.487773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] PATH_INFO: `/v3/users/c1432d9ec6264ba5865fa0d7e9250a35` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:55.489023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1432d9ec6264ba5865fa0d7e9250a35)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:55.491044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:55.549099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1432d9ec6264ba5865fa0d7e9250a35'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.549904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1432d9ec6264ba5865fa0d7e9250a35'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.558989 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1432d9ec6264ba5865fa0d7e9250a35'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.559817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1432d9ec6264ba5865fa0d7e9250a35'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.567778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4451864-2569-4e9b-9cd0-4378d76a4962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1432d9ec6264ba5865fa0d7e9250a35'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:55.595229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1096/2202] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:55 2022] DELETE /identity/v3/users/c1432d9ec6264ba5865fa0d7e9250a35 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:55.888881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:55.894924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:55.913358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e9917-491f-4338-8cf1-77d31b0fb6ef admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.006970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.008512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.009139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.009716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] PATH_INFO: `/v3/projects/85745d389327461b979960c6611b69fa` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.012350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85745d389327461b979960c6611b69fa)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.017301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.077192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85745d389327461b979960c6611b69fa', 'request_id': 'req-9a52b899-764f-49b7-a0b9-7eacf547d263'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:56.084663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85745d389327461b979960c6611b69fa', 'request_id': 'req-9a52b899-764f-49b7-a0b9-7eacf547d263'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:56.091047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85745d389327461b979960c6611b69fa', 'request_id': 'req-9a52b899-764f-49b7-a0b9-7eacf547d263'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:56.105820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] The token cache is being invalidate because project 85745d389327461b979960c6611b69fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:56.106122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:56.106861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a52b899-764f-49b7-a0b9-7eacf547d263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:56.108451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1107/2203] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:55 2022] DELETE /identity/v3/projects/85745d389327461b979960c6611b69fa => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:56.113414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c98f8-b180-4599-9a5d-bd41ba44de0d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.113779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c98f8-b180-4599-9a5d-bd41ba44de0d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.114145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c98f8-b180-4599-9a5d-bd41ba44de0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.133015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab3c98f8-b180-4599-9a5d-bd41ba44de0d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:56.134261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab3c98f8-b180-4599-9a5d-bd41ba44de0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:56.191195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:56.208429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1097/2204] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:56.216572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50267b-4858-4ea4-8e86-54866627e545 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.216870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50267b-4858-4ea4-8e86-54866627e545 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.217157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50267b-4858-4ea4-8e86-54866627e545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.239435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-de50267b-4858-4ea4-8e86-54866627e545 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:56.241312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-de50267b-4858-4ea4-8e86-54866627e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:56.250370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1108/2205] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:56.255013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c98f8-b180-4599-9a5d-bd41ba44de0d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.264804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c98f8-b180-4599-9a5d-bd41ba44de0d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.271062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.271729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.272009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.272282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.273032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:56.273337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.275046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.288618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1098/2206] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:56.293324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50267b-4858-4ea4-8e86-54866627e545 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.303413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50267b-4858-4ea4-8e86-54866627e545 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.308574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.309239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.309530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.309807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.310561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.312479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.343687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1109/2207] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:56 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:56.348061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.359471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf30e32-7e0d-48dc-9c83-91ec2ab92948 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.420510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.421213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.421556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.421733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.422491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.424437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.450438 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1099/2208] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:56 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:56.454422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.466232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c917037-32de-488f-a17a-595fc9236f61 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.471479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.472245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.472604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.472969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.473775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.476095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.483937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:56.494121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1110/2209] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:56.495719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.507757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8fb49-093c-416e-bf2a-459752932928 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.512388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b987-09b7-4990-b530-d86173099be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.513069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b987-09b7-4990-b530-d86173099be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.513352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b987-09b7-4990-b530-d86173099be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.513624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b987-09b7-4990-b530-d86173099be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.514392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b987-09b7-4990-b530-d86173099be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.515984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b987-09b7-4990-b530-d86173099be1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.527366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1100/2210] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:56.531515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.542712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645f0be-9011-4e78-abff-ca98a49fb573 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.547484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.548372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.548661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.548945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] PATH_INFO: `/v3/projects/1d871ac27bf047409ea4d9f94d7d6c05/users/3ce7325a0e2b4e5fbef00339ce39a5d6/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.564126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d871ac27bf047409ea4d9f94d7d6c05, user_id=3ce7325a0e2b4e5fbef00339ce39a5d6, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.566840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.580028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1111/2211] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:56 2022] PUT /identity/v3/projects/1d871ac27bf047409ea4d9f94d7d6c05/users/3ce7325a0e2b4e5fbef00339ce39a5d6/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:56.595479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e240227-1960-4459-a8e8-dcf72abd5108 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.595770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e240227-1960-4459-a8e8-dcf72abd5108 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.596075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e240227-1960-4459-a8e8-dcf72abd5108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.623476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0e240227-1960-4459-a8e8-dcf72abd5108 None None] MFA Rules not processed for user `3ce7325a0e2b4e5fbef00339ce39a5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:56.624693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0e240227-1960-4459-a8e8-dcf72abd5108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:56.689666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1101/2212] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:56.694019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.766135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4d1dc-5ca4-478b-b033-63c8edd5f330 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.770968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.772171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.772452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.772729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.774121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.775547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.805193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1112/2213] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:56 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:56.811211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e240227-1960-4459-a8e8-dcf72abd5108 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.822957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e240227-1960-4459-a8e8-dcf72abd5108 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.868474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:56.883929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.884746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.885133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.885529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.886402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.889008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.918453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1102/2214] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:56 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:56.922490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.933354 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a784b0-e08f-41f3-abd1-1007803a504a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.938516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.939202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.939543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.939824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.940571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.942250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:56.954773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1113/2215] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:56.958925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:56.969584 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03cabf-de2f-4d15-a740-65096c9817f5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:56.974614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1bd4c-110d-422d-9178-e9613b9b97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:56.975508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1bd4c-110d-422d-9178-e9613b9b97be admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:56.975788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1bd4c-110d-422d-9178-e9613b9b97be admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:56.976249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1bd4c-110d-422d-9178-e9613b9b97be admin admin] PATH_INFO: `/v3/projects/0a8f36e9e98d4ec485ae75fd8a19d45a/users/39c1d4dac6084b6693d3702dec7c6a6c/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:56.993237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1bd4c-110d-422d-9178-e9613b9b97be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8f36e9e98d4ec485ae75fd8a19d45a, user_id=39c1d4dac6084b6693d3702dec7c6a6c, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:56.995960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1bd4c-110d-422d-9178-e9613b9b97be admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:57.009863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1103/2216] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:56 2022] PUT /identity/v3/projects/0a8f36e9e98d4ec485ae75fd8a19d45a/users/39c1d4dac6084b6693d3702dec7c6a6c/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:57.013893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:57.025174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192baf8-e381-4ecd-8edb-d396539c373c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:57.089033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:57.089722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.090008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.090323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.091089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:57.091719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.092010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.092293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.092708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:57.107102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1114/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:57.108384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:57.109777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] MFA Rules not processed for user `1184a6a19fa242ae973bf635b56b1f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:57.111045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:57.119621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93db0b-e5b7-4371-a7ae-7b55f853171b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:57.124356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeef78-9b78-400a-ad02-36e3f9c09141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:57.125284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeef78-9b78-400a-ad02-36e3f9c09141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.125567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeef78-9b78-400a-ad02-36e3f9c09141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.125845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeef78-9b78-400a-ad02-36e3f9c09141 admin admin] PATH_INFO: `/v3/projects/0a8f36e9e98d4ec485ae75fd8a19d45a/users/39c1d4dac6084b6693d3702dec7c6a6c/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.127887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeef78-9b78-400a-ad02-36e3f9c09141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8f36e9e98d4ec485ae75fd8a19d45a, user_id=39c1d4dac6084b6693d3702dec7c6a6c, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:57.130545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeef78-9b78-400a-ad02-36e3f9c09141 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:57.143190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1115/2218] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:57 2022] PUT /identity/v3/projects/0a8f36e9e98d4ec485ae75fd8a19d45a/users/39c1d4dac6084b6693d3702dec7c6a6c/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:57.157012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092f32a-7117-4109-8ace-71caa66a557a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.157320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092f32a-7117-4109-8ace-71caa66a557a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.157570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092f32a-7117-4109-8ace-71caa66a557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.171797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1104/2219] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:57.189815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1092f32a-7117-4109-8ace-71caa66a557a None None] MFA Rules not processed for user `39c1d4dac6084b6693d3702dec7c6a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:57.191068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1092f32a-7117-4109-8ace-71caa66a557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:57.212835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:57.272772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1116/2220] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:15:57.284453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:57.286143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:57.348947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c31ace-2702-43cd-a5b6-1bc18c6823f3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:57.400456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519a7c2-8f79-4655-babe-ae4fd543f0a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:57.401112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a7c2-8f79-4655-babe-ae4fd543f0a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.401392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a7c2-8f79-4655-babe-ae4fd543f0a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.401662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a7c2-8f79-4655-babe-ae4fd543f0a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.411365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519a7c2-8f79-4655-babe-ae4fd543f0a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:57.412841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519a7c2-8f79-4655-babe-ae4fd543f0a5 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:57.423418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1105/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:57.489714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092f32a-7117-4109-8ace-71caa66a557a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:57.571551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092f32a-7117-4109-8ace-71caa66a557a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:57.576459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:57.577512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.577798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.578073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] PATH_INFO: `/v3/users/3ce7325a0e2b4e5fbef00339ce39a5d6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.579347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce7325a0e2b4e5fbef00339ce39a5d6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:57.581294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:57.639057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce7325a0e2b4e5fbef00339ce39a5d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:57.652559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce7325a0e2b4e5fbef00339ce39a5d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:57.661604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce7325a0e2b4e5fbef00339ce39a5d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:57.674145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce7325a0e2b4e5fbef00339ce39a5d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:57.674810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce7325a0e2b4e5fbef00339ce39a5d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:57.682561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1117/2222] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:57 2022] DELETE /identity/v3/users/3ce7325a0e2b4e5fbef00339ce39a5d6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:15:57.687089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.687376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.687655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.706197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:57.707421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:57.717815 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:57.784692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1106/2223] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:57.794989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:57.796551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:57.856271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:57.882474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f200-ffa1-4925-a7ac-fec73bac480d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:57.887175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:57.889313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:57.889313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:57.889313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:57.901713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:57.903555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:57.915230 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1118/2224] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:58.256894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:58.258887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:58.283669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f017a-4d3d-4f5a-8b9e-8d5bab6f9a7f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:58.291932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:58.292908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:58.293189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:58.293457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] PATH_INFO: `/v3/projects/1d871ac27bf047409ea4d9f94d7d6c05` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:58.294825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d871ac27bf047409ea4d9f94d7d6c05)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:58.296825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:58.348463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d871ac27bf047409ea4d9f94d7d6c05', 'request_id': 'req-36f8e28b-77e1-4680-afde-1f5d419ea285'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.357058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d871ac27bf047409ea4d9f94d7d6c05', 'request_id': 'req-36f8e28b-77e1-4680-afde-1f5d419ea285'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.362908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d871ac27bf047409ea4d9f94d7d6c05', 'request_id': 'req-36f8e28b-77e1-4680-afde-1f5d419ea285'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.375786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] The token cache is being invalidate because project 1d871ac27bf047409ea4d9f94d7d6c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:58.376103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.376776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.378458 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1107/2225] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:58 2022] DELETE /identity/v3/projects/1d871ac27bf047409ea4d9f94d7d6c05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:58.382550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:58.392565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fec42-9655-4d21-ac33-30b11ee332eb service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:58.450150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:58.451073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:58.451359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:58.451641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] PATH_INFO: `/v3/users/39c1d4dac6084b6693d3702dec7c6a6c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:58.452858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c1d4dac6084b6693d3702dec7c6a6c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:58.454815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:58.508210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c1d4dac6084b6693d3702dec7c6a6c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.521144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c1d4dac6084b6693d3702dec7c6a6c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.528680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c1d4dac6084b6693d3702dec7c6a6c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.537670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c1d4dac6084b6693d3702dec7c6a6c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.538356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1db9377e-b92e-4b81-bce7-8ed2046ba607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c1d4dac6084b6693d3702dec7c6a6c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:58.544862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1119/2226] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:58 2022] DELETE /identity/v3/users/39c1d4dac6084b6693d3702dec7c6a6c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:58.834667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:58.836221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:58.852215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e28b-77e1-4680-afde-1f5d419ea285 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:58.933540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:58.934632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:58.935120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:58.935330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] PATH_INFO: `/v3/projects/0a8f36e9e98d4ec485ae75fd8a19d45a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:58.936562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8f36e9e98d4ec485ae75fd8a19d45a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:58.938544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:58.991602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:59.000618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8f36e9e98d4ec485ae75fd8a19d45a', 'request_id': 'req-91e10467-d5f7-484c-92b9-9f27b22b26cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.012539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8f36e9e98d4ec485ae75fd8a19d45a', 'request_id': 'req-91e10467-d5f7-484c-92b9-9f27b22b26cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.018867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8f36e9e98d4ec485ae75fd8a19d45a', 'request_id': 'req-91e10467-d5f7-484c-92b9-9f27b22b26cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.031405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] The token cache is being invalidate because project 0a8f36e9e98d4ec485ae75fd8a19d45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:15:59.031688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.032348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-91e10467-d5f7-484c-92b9-9f27b22b26cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.033895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1108/2227] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:15:58 2022] DELETE /identity/v3/projects/0a8f36e9e98d4ec485ae75fd8a19d45a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:59.039557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51d29-549d-42ac-a95f-8ab272cd5979 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.039846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51d29-549d-42ac-a95f-8ab272cd5979 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.040125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51d29-549d-42ac-a95f-8ab272cd5979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.064388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1fe51d29-549d-42ac-a95f-8ab272cd5979 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:59.065627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1fe51d29-549d-42ac-a95f-8ab272cd5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:59.129625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:59.140987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1120/2228] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:59.149505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c866a-0fee-4097-9469-3340f4023707 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.149820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c866a-0fee-4097-9469-3340f4023707 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.150115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c866a-0fee-4097-9469-3340f4023707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.171940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-281c866a-0fee-4097-9469-3340f4023707 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:59.173079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-281c866a-0fee-4097-9469-3340f4023707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:59.181179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1109/2229] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:59.185401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51d29-549d-42ac-a95f-8ab272cd5979 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.195845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51d29-549d-42ac-a95f-8ab272cd5979 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.200938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.201368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.201609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.201894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.202688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:15:59.203001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.204627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.222233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1121/2230] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:15:59.224489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c866a-0fee-4097-9469-3340f4023707 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.238320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c866a-0fee-4097-9469-3340f4023707 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.243364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.244112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.244402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.244685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.245405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.247385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.276536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1110/2231] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:15:59 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:59.280908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.291323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910de98-8b38-4f88-b133-921de73c6edb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.351329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.352271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.352553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.352831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.353534 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.355486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.377517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1122/2232] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:15:59 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:15:59.382090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.393599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4146d-1092-4005-9c27-1841ba445964 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.399086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.399776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.400064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.400344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.401089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.402731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.413621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1111/2233] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:59.417938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.429426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac7e6-41a4-407b-8861-1055a3bc7df3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.434362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006cde-9b38-4214-adbd-93b8c2e0169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.435038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006cde-9b38-4214-adbd-93b8c2e0169f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.435320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006cde-9b38-4214-adbd-93b8c2e0169f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.435598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006cde-9b38-4214-adbd-93b8c2e0169f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.436353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4006cde-9b38-4214-adbd-93b8c2e0169f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.437945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4006cde-9b38-4214-adbd-93b8c2e0169f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.449384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1123/2234] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:15:59.453600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.464126 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1969d7-71f6-4278-84ab-2df904248393 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.468805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.469695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.469978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.470283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] PATH_INFO: `/v3/projects/b7794a117aac41b1bf383e149c532019/users/cc1210107e8045e1a464e99f545dfb09/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.485674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7794a117aac41b1bf383e149c532019, user_id=cc1210107e8045e1a464e99f545dfb09, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.488375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.504300 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1112/2235] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:15:59 2022] PUT /identity/v3/projects/b7794a117aac41b1bf383e149c532019/users/cc1210107e8045e1a464e99f545dfb09/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:59.515298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59cdd-5459-45f7-8401-6a5bff7b81ff None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.515817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59cdd-5459-45f7-8401-6a5bff7b81ff None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.515909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59cdd-5459-45f7-8401-6a5bff7b81ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.547451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-78a59cdd-5459-45f7-8401-6a5bff7b81ff None None] MFA Rules not processed for user `cc1210107e8045e1a464e99f545dfb09`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:59.548807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-78a59cdd-5459-45f7-8401-6a5bff7b81ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:59.622103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1124/2236] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:15:59.634196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.635880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:15:59.725294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e38db2-2d46-45f0-9dab-aff3fbab4291 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.729231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fd32c-ddbe-4a63-b0d8-d02e77865b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.729876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd32c-ddbe-4a63-b0d8-d02e77865b52 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.730157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd32c-ddbe-4a63-b0d8-d02e77865b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.730487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd32c-ddbe-4a63-b0d8-d02e77865b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.739645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fd32c-ddbe-4a63-b0d8-d02e77865b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.741659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fd32c-ddbe-4a63-b0d8-d02e77865b52 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.751085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1113/2237] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:15:59.771340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59cdd-5459-45f7-8401-6a5bff7b81ff None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:15:59.830730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:15:59.837539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59cdd-5459-45f7-8401-6a5bff7b81ff None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:15:59.842894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:15:59.843426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.843707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.843985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] PATH_INFO: `/v3/users/cc1210107e8045e1a464e99f545dfb09` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.845206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1210107e8045e1a464e99f545dfb09)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:15:59.847193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:15:59.896808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1210107e8045e1a464e99f545dfb09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.913356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1210107e8045e1a464e99f545dfb09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.922205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1210107e8045e1a464e99f545dfb09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.933417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1210107e8045e1a464e99f545dfb09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.934188 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1210107e8045e1a464e99f545dfb09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:15:59.948298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1125/2238] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:15:59 2022] DELETE /identity/v3/users/cc1210107e8045e1a464e99f545dfb09 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:15:59.950221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:15:59.951190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:15:59.951639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:15:59.972475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:15:59.972475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:00.084829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1114/2239] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:00.109506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:00.111344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:00.234084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6db0ec-4c76-4fd7-a469-55d66164c22c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:00.239141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f704-b383-414b-9793-2376411d8216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:00.239141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f704-b383-414b-9793-2376411d8216 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:00.239372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f704-b383-414b-9793-2376411d8216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:00.239624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f704-b383-414b-9793-2376411d8216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:00.254490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f704-b383-414b-9793-2376411d8216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:00.256352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f704-b383-414b-9793-2376411d8216 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:00.269724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1126/2240] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:00.689569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:00.691093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:00.712562 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc81e2-ad65-455a-bbe9-5953e8b61ee9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:00.718901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:00.719812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:00.720545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:00.720833 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] PATH_INFO: `/v3/projects/b7794a117aac41b1bf383e149c532019` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:00.722111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7794a117aac41b1bf383e149c532019)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:00.724279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:00.727335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:00.787296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7794a117aac41b1bf383e149c532019', 'request_id': 'req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:00.796870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7794a117aac41b1bf383e149c532019', 'request_id': 'req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:00.803626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7794a117aac41b1bf383e149c532019', 'request_id': 'req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:00.818576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] The token cache is being invalidate because project b7794a117aac41b1bf383e149c532019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:16:00.818917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:00.819518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-03e8e2c9-a64e-4b68-9d00-24ab721f9d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:00.821217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1115/2241] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:16:00 2022] DELETE /identity/v3/projects/b7794a117aac41b1bf383e149c532019 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:00.826618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a7d1-b25f-40ff-a023-da62f70d9233 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:00.827153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a7d1-b25f-40ff-a023-da62f70d9233 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:00.827153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a7d1-b25f-40ff-a023-da62f70d9233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:00.848381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5fa8a7d1-b25f-40ff-a023-da62f70d9233 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:00.849763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fa8a7d1-b25f-40ff-a023-da62f70d9233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:00.953274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1127/2242] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:00.968787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d4b8-4970-49c6-845e-22a8012b1be1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:00.969446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d4b8-4970-49c6-845e-22a8012b1be1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:00.969446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d4b8-4970-49c6-845e-22a8012b1be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:00.988778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b0c9d4b8-4970-49c6-845e-22a8012b1be1 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:00.990638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b0c9d4b8-4970-49c6-845e-22a8012b1be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:01.000180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1116/2243] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:01.004565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a7d1-b25f-40ff-a023-da62f70d9233 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:01.015156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a7d1-b25f-40ff-a023-da62f70d9233 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:01.019821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:01.020480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.020763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.021039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.021821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:16:01.022125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:01.023766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:01.036074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1128/2244] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:16:01.040722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d4b8-4970-49c6-845e-22a8012b1be1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:01.050493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d4b8-4970-49c6-845e-22a8012b1be1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:01.055807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:01.056479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.056764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.057043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.057763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:01.059770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:01.089553 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1117/2245] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:16:01 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:01.092816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:01.099434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:01.104014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e70e2-127b-4a1f-aa45-c0eded4d890e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:01.167161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:01.168007 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.168431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.168888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.169655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:01.171613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:01.195879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1129/2246] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:16:01 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:01.199700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:01.212593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef411c26-299a-4c25-bc2c-2086ddd72eec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:01.217924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:01.218637 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.218920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.219195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.219941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:01.222627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:01.237738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1118/2247] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:16:01.242259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:01.252875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6c732-8000-48d3-a469-686f12128766 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:01.262190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3a9d9-1c36-4895-9595-dba8f0f010a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:01.262190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a9d9-1c36-4895-9595-dba8f0f010a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.262190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a9d9-1c36-4895-9595-dba8f0f010a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.262190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a9d9-1c36-4895-9595-dba8f0f010a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.262670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3a9d9-1c36-4895-9595-dba8f0f010a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:01.264010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3a9d9-1c36-4895-9595-dba8f0f010a0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:01.276976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1130/2248] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:01.281314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:01.314263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae6c23-87ea-4783-8d33-a6b78b756611 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:01.330360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:01.331286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.331569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.331842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] PATH_INFO: `/v3/projects/6d3829b7d42541dd9a287cf5d6f9fb93/users/6d411c0b784f4de19bb875f2827dbcd8/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.353786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3829b7d42541dd9a287cf5d6f9fb93, user_id=6d411c0b784f4de19bb875f2827dbcd8, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:01.356543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:01.378227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1119/2249] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:16:01 2022] PUT /identity/v3/projects/6d3829b7d42541dd9a287cf5d6f9fb93/users/6d411c0b784f4de19bb875f2827dbcd8/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:01.389195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ae66f-3d5e-41a9-84ab-2c2ca1f57f27 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.389753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ae66f-3d5e-41a9-84ab-2c2ca1f57f27 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.390262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ae66f-3d5e-41a9-84ab-2c2ca1f57f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.425970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-482ae66f-3d5e-41a9-84ab-2c2ca1f57f27 None None] MFA Rules not processed for user `6d411c0b784f4de19bb875f2827dbcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:01.428408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-482ae66f-3d5e-41a9-84ab-2c2ca1f57f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:01.526319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1131/2250] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:01.535760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:01.543393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:01.614219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a8c25-944e-4ab0-ada5-e60db7527ee0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:01.619144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:01.619849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:01.620128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:01.620400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:01.629464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:01.631586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:01.643352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1120/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:04.388481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f1f1-6ae2-4d80-9c3d-6bdccebcac61 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:04.389010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f1f1-6ae2-4d80-9c3d-6bdccebcac61 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:04.389109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f1f1-6ae2-4d80-9c3d-6bdccebcac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:04.407497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8a30f1f1-6ae2-4d80-9c3d-6bdccebcac61 None None] MFA Rules not processed for user `b0ff075d9612455a93a898413e8a948e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:04.408708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a30f1f1-6ae2-4d80-9c3d-6bdccebcac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:04.466750 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1132/2252] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:11.638356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:14.459104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:15.440709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:15.512231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34b9bb-d4c9-4898-bf75-a7a3bd45051c service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:15.516765 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:15.517642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:15.517924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:15.518241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] PATH_INFO: `/v3/users/6d411c0b784f4de19bb875f2827dbcd8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:15.519472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d411c0b784f4de19bb875f2827dbcd8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:15.521418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:15.572652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d411c0b784f4de19bb875f2827dbcd8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:15.573328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d411c0b784f4de19bb875f2827dbcd8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:15.580435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d411c0b784f4de19bb875f2827dbcd8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:15.581133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d411c0b784f4de19bb875f2827dbcd8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:15.589608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d411c0b784f4de19bb875f2827dbcd8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:15.615060 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1121/2253] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:16:15 2022] DELETE /identity/v3/users/6d411c0b784f4de19bb875f2827dbcd8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:15.620360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:15.620894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:15.621019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:15.640052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:15.641277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:15.718105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1133/2254] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:15.728982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:15.730543 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:15.815982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97ab9b-6ad6-41fa-a574-5427c39b6291 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:15.821511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaad200-3ccf-4154-9e5b-7bfe5a966227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:15.822280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad200-3ccf-4154-9e5b-7bfe5a966227 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:15.822554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad200-3ccf-4154-9e5b-7bfe5a966227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:15.822779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad200-3ccf-4154-9e5b-7bfe5a966227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:15.833616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaad200-3ccf-4154-9e5b-7bfe5a966227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:15.835128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaad200-3ccf-4154-9e5b-7bfe5a966227 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:15.845698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1122/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:16.196181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.197749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:16.216746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd286f4-08c8-4ce0-8fc1-c9e45dff3139 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.228682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.229566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.230314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.230427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] PATH_INFO: `/v3/projects/6d3829b7d42541dd9a287cf5d6f9fb93` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.231879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3829b7d42541dd9a287cf5d6f9fb93)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.233987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:16.292586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3829b7d42541dd9a287cf5d6f9fb93', 'request_id': 'req-4dd06666-6a87-4518-a411-107835d84d14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:16.299458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3829b7d42541dd9a287cf5d6f9fb93', 'request_id': 'req-4dd06666-6a87-4518-a411-107835d84d14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:16.305426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3829b7d42541dd9a287cf5d6f9fb93', 'request_id': 'req-4dd06666-6a87-4518-a411-107835d84d14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:16.327787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] The token cache is being invalidate because project 6d3829b7d42541dd9a287cf5d6f9fb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:16:16.328076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:16.328725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4dd06666-6a87-4518-a411-107835d84d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:16.330367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1134/2256] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:16:16 2022] DELETE /identity/v3/projects/6d3829b7d42541dd9a287cf5d6f9fb93 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:16.336209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fa02-1569-4f8b-b654-e586f6b6f6b1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.336566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fa02-1569-4f8b-b654-e586f6b6f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.336911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fa02-1569-4f8b-b654-e586f6b6f6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.357014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2c14fa02-1569-4f8b-b654-e586f6b6f6b1 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:16.358258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2c14fa02-1569-4f8b-b654-e586f6b6f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:16.375761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:16.428086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1123/2257] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:16:16.436971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf51e-b6c6-4d38-83c7-1ddd7a9f07c7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.437313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf51e-b6c6-4d38-83c7-1ddd7a9f07c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.437697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf51e-b6c6-4d38-83c7-1ddd7a9f07c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.457476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-298cf51e-b6c6-4d38-83c7-1ddd7a9f07c7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:16.458738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-298cf51e-b6c6-4d38-83c7-1ddd7a9f07c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:16.467345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1135/2258] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:16.472219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fa02-1569-4f8b-b654-e586f6b6f6b1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.483045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fa02-1569-4f8b-b654-e586f6b6f6b1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.487802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.488479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.488768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.489045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.489800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:16:16.490115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.494351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:16.508601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1124/2259] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:16:16.512984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cf51e-b6c6-4d38-83c7-1ddd7a9f07c7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.523265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cf51e-b6c6-4d38-83c7-1ddd7a9f07c7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.528002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.528670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.528951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.529227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.529939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.531886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:16.560008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1136/2260] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:16:16 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:16.564222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.574863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62f0b3-342a-445a-9257-417c2b99ae5a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.641339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.642021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.642335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.642618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.643319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.645252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:16.669322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1125/2261] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:16:16 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:16.670588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.681816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024af66f-ac4e-4b06-bc71-96e021f3f029 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.686757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.687486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.687718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.688016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.688847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.690987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:16.703415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1137/2262] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:16.707716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.718387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ef57a-bfdd-4f3b-917f-0df07d805039 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.723289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74fd6-3132-42f2-9531-40275df24fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.723995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74fd6-3132-42f2-9531-40275df24fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.724281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74fd6-3132-42f2-9531-40275df24fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.724577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74fd6-3132-42f2-9531-40275df24fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.725310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74fd6-3132-42f2-9531-40275df24fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.727226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74fd6-3132-42f2-9531-40275df24fcc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:16.740124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1126/2263] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:16.743828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.753286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2f10d-5ad2-4644-9477-1de33e40c178 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.758667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.759563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.759843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.760115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] PATH_INFO: `/v3/projects/742db09eefa94cd492947aeb3a8a18cd/users/2cca3376ce154c70a96e11d9f83984a4/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.776915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=742db09eefa94cd492947aeb3a8a18cd, user_id=2cca3376ce154c70a96e11d9f83984a4, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.779664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:16.794591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1138/2264] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:16:16 2022] PUT /identity/v3/projects/742db09eefa94cd492947aeb3a8a18cd/users/2cca3376ce154c70a96e11d9f83984a4/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:16.805460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74ff3-365d-4063-b263-4f4d4a74ac17 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.805753 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74ff3-365d-4063-b263-4f4d4a74ac17 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.806034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74ff3-365d-4063-b263-4f4d4a74ac17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.835144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5ab74ff3-365d-4063-b263-4f4d4a74ac17 None None] MFA Rules not processed for user `2cca3376ce154c70a96e11d9f83984a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:16.836381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5ab74ff3-365d-4063-b263-4f4d4a74ac17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:16.902049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1127/2265] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:16.913344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:16.915079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:16.937621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:16.982466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5d81-bcb8-4c8b-9d79-f67eee05d86a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:16.986273 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164a361891274af1b20fe7b7458ecde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:16.986946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:16.987373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:16.987671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:16.998055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:16.999555 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:17.012326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1139/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:19.656726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:19.657285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:19.657285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:19.677962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:19.679826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:19.698655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:19.747016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1128/2267] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:19.790777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:19.792586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:19.872728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608a8c7-afec-4a4a-8345-3ac01f88b4d7 service glance] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:19.877949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c984c0-1763-4e02-a892-e23902910386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:19.878747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c984c0-1763-4e02-a892-e23902910386 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:19.879031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c984c0-1763-4e02-a892-e23902910386 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:19.879324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c984c0-1763-4e02-a892-e23902910386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:19.891300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c984c0-1763-4e02-a892-e23902910386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:19.893344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c984c0-1763-4e02-a892-e23902910386 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:19.903004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1140/2268] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:16:25.921419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:25.923282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:26.019135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a474a-0efd-45e3-920c-7c0cdb9e63cb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:26.024862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:26.025919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:26.026114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:26.026526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] PATH_INFO: `/v3/users/9160e720419f4034a1c0fae03664b51d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:26.027906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9160e720419f4034a1c0fae03664b51d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:26.030063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:26.106618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9160e720419f4034a1c0fae03664b51d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:26.107571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9160e720419f4034a1c0fae03664b51d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:26.122494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9160e720419f4034a1c0fae03664b51d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:26.123690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9160e720419f4034a1c0fae03664b51d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:26.139405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9160e720419f4034a1c0fae03664b51d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:26.171490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1129/2269] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:16:25 2022] DELETE /identity/v3/users/9160e720419f4034a1c0fae03664b51d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:26.178412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:26.179671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:26.180332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:26.204602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:26.205940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:26.295473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1141/2270] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:26.307839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:26.310393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:26.443471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:26.464218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7e79-ecfd-46ef-9052-1172c7874ed7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:26.480201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed447f9-167b-40d8-a171-fc9664cb069a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:26.480930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed447f9-167b-40d8-a171-fc9664cb069a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:26.481360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed447f9-167b-40d8-a171-fc9664cb069a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:26.481605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed447f9-167b-40d8-a171-fc9664cb069a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:26.510316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed447f9-167b-40d8-a171-fc9664cb069a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:26.513946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed447f9-167b-40d8-a171-fc9664cb069a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:26.536398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1130/2271] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:27.045308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:27.047314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:27.082762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85d69-4e71-415d-9172-0efa535ed280 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:27.087795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:27.089310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.089774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.089970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] PATH_INFO: `/v3/projects/328b4193def54a6d9d64289979a889db` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.091171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] RBAC: Authorizing `identity:delete_project(project_id=328b4193def54a6d9d64289979a889db)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:27.093120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:27.184325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:27.188996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328b4193def54a6d9d64289979a889db', 'request_id': 'req-6cb4491d-9c19-4d11-aa1b-38e601ed811b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:27.203911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328b4193def54a6d9d64289979a889db', 'request_id': 'req-6cb4491d-9c19-4d11-aa1b-38e601ed811b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:27.233530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328b4193def54a6d9d64289979a889db', 'request_id': 'req-6cb4491d-9c19-4d11-aa1b-38e601ed811b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:27.272105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] The token cache is being invalidate because project 328b4193def54a6d9d64289979a889db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:16:27.272506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:27.275461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6cb4491d-9c19-4d11-aa1b-38e601ed811b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:27.282349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1142/2272] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:16:27 2022] DELETE /identity/v3/projects/328b4193def54a6d9d64289979a889db => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:27.283511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6da9f-450b-4b9e-881f-72ec206a1225 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.283992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6da9f-450b-4b9e-881f-72ec206a1225 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.284074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6da9f-450b-4b9e-881f-72ec206a1225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.313766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d2e6da9f-450b-4b9e-881f-72ec206a1225 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:27.315112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d2e6da9f-450b-4b9e-881f-72ec206a1225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:27.394226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1131/2273] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:27.408568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4403-5013-42ff-8955-d6159401bf5f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.408568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4403-5013-42ff-8955-d6159401bf5f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.408568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4403-5013-42ff-8955-d6159401bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.435068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e88f4403-5013-42ff-8955-d6159401bf5f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:27.436605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e88f4403-5013-42ff-8955-d6159401bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:27.449790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1143/2274] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:27.451345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6da9f-450b-4b9e-881f-72ec206a1225 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:27.470068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6da9f-450b-4b9e-881f-72ec206a1225 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:27.479568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:27.480484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.480997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.481343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.482302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:16:27.483044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:27.485514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:27.506099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1132/2275] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:16:27.511426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f4403-5013-42ff-8955-d6159401bf5f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:27.521717 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f4403-5013-42ff-8955-d6159401bf5f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:27.527638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:27.528408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.528918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.529524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.530101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:27.532158 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:27.570210 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1144/2276] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:16:27.572532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:27.583151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a551c-97e2-4691-8ea4-972be2da940f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:27.659319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:27.660110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.660518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.661137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.662039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:27.665132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:27.690966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1133/2277] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:16:27 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:27.695561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:27.706535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2008e-9065-4023-b893-4f680d1da2a3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:27.712838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:27.713603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.714017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.714345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.715100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:27.716922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:27.730935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1145/2278] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:27.735559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:27.750218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be26753-1d50-46d4-83b9-a6fc763b09d1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:27.756723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06187167-57a3-4679-a42c-b9ae9a3930a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:27.758121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187167-57a3-4679-a42c-b9ae9a3930a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.758667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187167-57a3-4679-a42c-b9ae9a3930a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.759217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187167-57a3-4679-a42c-b9ae9a3930a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.760281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06187167-57a3-4679-a42c-b9ae9a3930a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:27.762874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06187167-57a3-4679-a42c-b9ae9a3930a7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:27.782347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1134/2279] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:27.784268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:27.798242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a15c8f-e8a4-47dc-8066-93a2b48bdd1c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:27.803568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:27.804702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.804970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.805435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] PATH_INFO: `/v3/projects/0cb80fbd897d43bc911368ca7edc96a1/users/62fc7954e81a48a1b38a8c27f23b5321/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.824565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb80fbd897d43bc911368ca7edc96a1, user_id=62fc7954e81a48a1b38a8c27f23b5321, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:27.827407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:27.844510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1146/2280] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:16:27 2022] PUT /identity/v3/projects/0cb80fbd897d43bc911368ca7edc96a1/users/62fc7954e81a48a1b38a8c27f23b5321/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:27.856517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffa695-6511-4891-a681-e924d57e1ad4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:27.856882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffa695-6511-4891-a681-e924d57e1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:27.857229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffa695-6511-4891-a681-e924d57e1ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:27.902432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-23ffa695-6511-4891-a681-e924d57e1ad4 None None] MFA Rules not processed for user `62fc7954e81a48a1b38a8c27f23b5321`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:27.903690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-23ffa695-6511-4891-a681-e924d57e1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:27.960129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:28.017943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1135/2281] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:28.031077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:28.034549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:28.122554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e484-b86e-4ae9-9560-e0a9b46b72fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:28.127754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3c8d7-3541-4df8-b161-0ed6799acad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:28.128520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c8d7-3541-4df8-b161-0ed6799acad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:28.129105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c8d7-3541-4df8-b161-0ed6799acad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:28.129403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c8d7-3541-4df8-b161-0ed6799acad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:28.142313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3c8d7-3541-4df8-b161-0ed6799acad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:28.144527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3c8d7-3541-4df8-b161-0ed6799acad0 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:28.164126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1147/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:28.194125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffa695-6511-4891-a681-e924d57e1ad4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:28.288498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffa695-6511-4891-a681-e924d57e1ad4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:28.296812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:28.298707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:28.299133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:28.299431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] PATH_INFO: `/v3/users/62fc7954e81a48a1b38a8c27f23b5321` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:28.300738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62fc7954e81a48a1b38a8c27f23b5321)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:28.322922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:28.413498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62fc7954e81a48a1b38a8c27f23b5321'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:28.414798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62fc7954e81a48a1b38a8c27f23b5321'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:28.424233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62fc7954e81a48a1b38a8c27f23b5321'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:28.425144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62fc7954e81a48a1b38a8c27f23b5321'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:28.436129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62fc7954e81a48a1b38a8c27f23b5321'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:28.458028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1136/2283] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:16:28 2022] DELETE /identity/v3/users/62fc7954e81a48a1b38a8c27f23b5321 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:28.464368 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:28.464955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:28.464955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:28.500459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:28.501668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:28.578671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1148/2284] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:28.589320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:28.590856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:28.668402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8346a4-249b-44fc-b3e6-94d6980e6207 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:28.672403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61101a45-8b47-4542-927b-17f5ba1080e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:28.673201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101a45-8b47-4542-927b-17f5ba1080e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:28.673654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101a45-8b47-4542-927b-17f5ba1080e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:28.674059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101a45-8b47-4542-927b-17f5ba1080e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:28.685613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61101a45-8b47-4542-927b-17f5ba1080e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:28.687342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61101a45-8b47-4542-927b-17f5ba1080e1 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:28.700749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1137/2285] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:29.164337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:29.169879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:29.213017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe00fc-9d6a-4bed-b5dc-25684ab11761 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:29.232813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:29.233758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.234036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.234397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] PATH_INFO: `/v3/projects/0cb80fbd897d43bc911368ca7edc96a1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.235964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb80fbd897d43bc911368ca7edc96a1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:29.240017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:29.252781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:29.321650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb80fbd897d43bc911368ca7edc96a1', 'request_id': 'req-9ae91bf0-f624-48e6-9f07-e78605a9a047'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:29.331877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb80fbd897d43bc911368ca7edc96a1', 'request_id': 'req-9ae91bf0-f624-48e6-9f07-e78605a9a047'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:29.339682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb80fbd897d43bc911368ca7edc96a1', 'request_id': 'req-9ae91bf0-f624-48e6-9f07-e78605a9a047'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:29.365018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] The token cache is being invalidate because project 0cb80fbd897d43bc911368ca7edc96a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:16:29.365427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:29.366300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ae91bf0-f624-48e6-9f07-e78605a9a047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:29.368249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1149/2286] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:16:29 2022] DELETE /identity/v3/projects/0cb80fbd897d43bc911368ca7edc96a1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:29.373785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd992-387a-4dbc-b7e5-2fde5c69f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.374338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd992-387a-4dbc-b7e5-2fde5c69f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.374599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd992-387a-4dbc-b7e5-2fde5c69f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.386349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:29.412243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6fbfd992-387a-4dbc-b7e5-2fde5c69f7f6 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:29.413785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6fbfd992-387a-4dbc-b7e5-2fde5c69f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:29.530774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1138/2287] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:29.544963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822c5ef-a56f-4dae-a585-6cc944b55e66 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.545858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822c5ef-a56f-4dae-a585-6cc944b55e66 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.545858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822c5ef-a56f-4dae-a585-6cc944b55e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.575146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3822c5ef-a56f-4dae-a585-6cc944b55e66 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:29.576623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3822c5ef-a56f-4dae-a585-6cc944b55e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:29.590596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1150/2288] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:29.595054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd992-387a-4dbc-b7e5-2fde5c69f7f6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:29.606845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd992-387a-4dbc-b7e5-2fde5c69f7f6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:29.613986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:29.614986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.615629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.615995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.617632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:16:29.618220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:29.620452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:29.641082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1139/2289] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:16:29.645640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822c5ef-a56f-4dae-a585-6cc944b55e66 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:29.656860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822c5ef-a56f-4dae-a585-6cc944b55e66 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:29.662261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:29.663414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.663824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.664294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.665122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:29.667465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:29.712690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1151/2290] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:16:29 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:29.717045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:29.732565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3280a-6907-44c8-8a4b-e9fb758e13fa admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:29.811607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:29.812446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.812930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.813137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.813895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:29.816343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:29.846526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1140/2291] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:16:29 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:29.850976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:29.863097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2bc0-21ef-419f-a489-8941aaca9770 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:29.874114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:29.874862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.875152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.875433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.876182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:29.877796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:29.891765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1152/2292] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:29.896055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:29.911378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2377fd2-1151-4b66-b2db-171f9244adde admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:29.922084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d818e-3861-44d9-8b75-5ffda81cb5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:29.922084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d818e-3861-44d9-8b75-5ffda81cb5be admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.922084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d818e-3861-44d9-8b75-5ffda81cb5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.922084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d818e-3861-44d9-8b75-5ffda81cb5be admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.922747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d818e-3861-44d9-8b75-5ffda81cb5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:29.922849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d818e-3861-44d9-8b75-5ffda81cb5be admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:29.936938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1141/2293] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:29.941592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:29.954638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada62f63-6b57-40be-9e90-c0c5c850b44d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:29.960599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:29.962286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:29.962774 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:29.963432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] PATH_INFO: `/v3/projects/f9d14cb301204ac786d97cc954ed4e27/users/629ca9989ec04405927aebcf7c3770ef/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:29.984015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d14cb301204ac786d97cc954ed4e27, user_id=629ca9989ec04405927aebcf7c3770ef, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:29.987047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:30.006212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1153/2294] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:16:29 2022] PUT /identity/v3/projects/f9d14cb301204ac786d97cc954ed4e27/users/629ca9989ec04405927aebcf7c3770ef/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:16:30.011705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92be7d-22e2-495c-bc59-a9452510ad66 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:30.012013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92be7d-22e2-495c-bc59-a9452510ad66 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:30.012328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92be7d-22e2-495c-bc59-a9452510ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:30.036075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9f92be7d-22e2-495c-bc59-a9452510ad66 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:30.037436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9f92be7d-22e2-495c-bc59-a9452510ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:30.135822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1142/2295] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:30.147249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:30.150440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:30.223237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db670ed-5767-4c13-9db6-e463b3414814 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:30.228602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:30.229487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:30.229856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:30.230142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:30.249992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:30.251838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:30.265117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1154/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:36.595616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804d6d-25c7-42a7-a9e4-b55443455c24 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:36.613197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804d6d-25c7-42a7-a9e4-b55443455c24 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:36.625537 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804d6d-25c7-42a7-a9e4-b55443455c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:36.667746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:36.715489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-12804d6d-25c7-42a7-a9e4-b55443455c24 None None] MFA Rules not processed for user `629ca9989ec04405927aebcf7c3770ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:36.717739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-12804d6d-25c7-42a7-a9e4-b55443455c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:36.840763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1143/2297] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:36.845572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:36.858043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e90d-00f7-4d32-bc68-c0bfb189bb71 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:36.863722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:36.864604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:36.865046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:36.865335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:36.866048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:36.868798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:36.911993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1155/2298] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:16:36 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:36.916571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804d6d-25c7-42a7-a9e4-b55443455c24 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:36.944735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804d6d-25c7-42a7-a9e4-b55443455c24 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:37.041854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:37.042817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:37.043282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:37.043622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:37.045213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:37.047594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:37.077102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1144/2299] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:16:36 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:37.082367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:37.101154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa91c3f-530e-4630-b4c4-455209d587fd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:37.108839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:37.110114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:37.110756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:37.111369 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:37.112791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:37.135298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:37.187330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1156/2300] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:37.191453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:37.209329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392118-49e5-4842-8e8e-bcafb598c614 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:37.222025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:37.230489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:37.231045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:37.231500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] PATH_INFO: `/v3/projects/6c76c23c0b7b4601b0f8df89f7695c47/users/8ca794815ffe464d999261bb7e5a404b/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:37.264443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c76c23c0b7b4601b0f8df89f7695c47, user_id=8ca794815ffe464d999261bb7e5a404b, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:37.267382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:37.297210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1145/2301] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:16:37 2022] PUT /identity/v3/projects/6c76c23c0b7b4601b0f8df89f7695c47/users/8ca794815ffe464d999261bb7e5a404b/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:37.299090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:37.312835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:37.338297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78169bda-8bfb-40c0-8263-963b443dbaab admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:37.524218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b456-c9a0-48df-af6c-dc523b4a9d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:37.525044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b456-c9a0-48df-af6c-dc523b4a9d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:37.525335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b456-c9a0-48df-af6c-dc523b4a9d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:37.525620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b456-c9a0-48df-af6c-dc523b4a9d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:37.526788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b456-c9a0-48df-af6c-dc523b4a9d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:37.529481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b456-c9a0-48df-af6c-dc523b4a9d77 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:37.546135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1157/2302] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:37.550377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:37.562991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4720-ff3c-4d0e-9748-61459e049be7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:37.572386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:37.573354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:37.573864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:37.573976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] PATH_INFO: `/v3/projects/6c76c23c0b7b4601b0f8df89f7695c47/users/8ca794815ffe464d999261bb7e5a404b/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:37.577548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c76c23c0b7b4601b0f8df89f7695c47, user_id=8ca794815ffe464d999261bb7e5a404b, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:37.580257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:37.603484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1146/2303] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:16:37 2022] PUT /identity/v3/projects/6c76c23c0b7b4601b0f8df89f7695c47/users/8ca794815ffe464d999261bb7e5a404b/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:45.119827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c49d8-c570-4409-9de4-37f61e2aaa84 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:45.120476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c49d8-c570-4409-9de4-37f61e2aaa84 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:45.120476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c49d8-c570-4409-9de4-37f61e2aaa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:45.154658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-393c49d8-c570-4409-9de4-37f61e2aaa84 None None] MFA Rules not processed for user `8ca794815ffe464d999261bb7e5a404b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:45.155918 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-393c49d8-c570-4409-9de4-37f61e2aaa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:45.281042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1158/2304] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:45.746785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:45.748541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:45.832166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc8ce-9f1f-4e99-b59f-d6f1a378a93b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:45.835920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164a361891274af1b20fe7b7458ecde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:45.836575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:45.836859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:45.837149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:45.841661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:45.904563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:45.906156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:45.924172 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1147/2305] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:46.134907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561fa5-5f7c-4eb8-93bb-351691ae6510 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:46.136183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561fa5-5f7c-4eb8-93bb-351691ae6510 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:46.136474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561fa5-5f7c-4eb8-93bb-351691ae6510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:46.156249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-00561fa5-5f7c-4eb8-93bb-351691ae6510 None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:46.157829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-00561fa5-5f7c-4eb8-93bb-351691ae6510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:46.223813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1159/2306] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:46.237347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:46.242097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:46.324378 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9de28-2d76-401a-b6e2-ab1675ae68a7 service glance] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:46.329638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:46.330332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:46.330614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:46.330883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:46.340137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:46.341798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:46.352025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1148/2307] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:16:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:16:52.372256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0134-1fae-48ab-a0c9-c5c31f1ee5bd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:52.372880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0134-1fae-48ab-a0c9-c5c31f1ee5bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:52.372880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0134-1fae-48ab-a0c9-c5c31f1ee5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:52.392858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fb9c0134-1fae-48ab-a0c9-c5c31f1ee5bd None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:52.394537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fb9c0134-1fae-48ab-a0c9-c5c31f1ee5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:52.405815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1160/2308] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jul 21 10:16:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:52.446439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:52.462136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b988d-185f-492a-b837-1058bce00cdf service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:52.467820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a953630-150f-438b-9586-1af7f3d381ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:52.474024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953630-150f-438b-9586-1af7f3d381ac service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:52.474445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953630-150f-438b-9586-1af7f3d381ac service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:52.474796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953630-150f-438b-9586-1af7f3d381ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:52.494888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a953630-150f-438b-9586-1af7f3d381ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:52.497033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a953630-150f-438b-9586-1af7f3d381ac service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:52.509480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1149/2309] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:16:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:16:54.993373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af741ff-0e62-40c3-b260-e13e4cbc0426 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:54.995333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af741ff-0e62-40c3-b260-e13e4cbc0426 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:54.995597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af741ff-0e62-40c3-b260-e13e4cbc0426 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:54.997905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1161/2310] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jul 21 10:16:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:16:55.009807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:55.010386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:55.011294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:55.034843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:55.040367 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:55.092785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af741ff-0e62-40c3-b260-e13e4cbc0426 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:55.095449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3af741ff-0e62-40c3-b260-e13e4cbc0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:55.148221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:55.174548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1150/2311] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jul 21 10:16:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:55.181215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:55.186540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:55.205200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534656f-fdc3-41a5-91fa-ab2cbd0729a3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:55.215014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:55.215697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:55.215841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af741ff-0e62-40c3-b260-e13e4cbc0426 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:55.215988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:55.216254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:55.225093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:55.225093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:55.225093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:55.225093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] PATH_INFO: `/v3/users/8c56cd1659d1439193221dfb93902ad2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:55.227621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:55.229607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:55.231701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c56cd1659d1439193221dfb93902ad2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:55.235004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:55.246346 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1151/2312] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:55.301795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c56cd1659d1439193221dfb93902ad2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.321437 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c56cd1659d1439193221dfb93902ad2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.331802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c56cd1659d1439193221dfb93902ad2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.340584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c56cd1659d1439193221dfb93902ad2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.341348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29051831-b82a-45a6-a58d-e77b2a2af154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c56cd1659d1439193221dfb93902ad2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.349902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1162/2313] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:16:55 2022] DELETE /identity/v3/users/8c56cd1659d1439193221dfb93902ad2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:16:55.578146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:55.594910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:55.604999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839f38-5e85-4eab-acbb-ae0f01ec9ce5 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:55.729903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:55.730856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:55.731144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:55.731422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] PATH_INFO: `/v3/projects/90b97e5230bb4d30a10f8314de4f4d42` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:55.732755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b97e5230bb4d30a10f8314de4f4d42)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:55.734777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:55.797497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b97e5230bb4d30a10f8314de4f4d42', 'request_id': 'req-287530a0-798b-4342-9385-ab22623b800b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.810315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b97e5230bb4d30a10f8314de4f4d42', 'request_id': 'req-287530a0-798b-4342-9385-ab22623b800b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.826246 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b97e5230bb4d30a10f8314de4f4d42', 'request_id': 'req-287530a0-798b-4342-9385-ab22623b800b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.835899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] The token cache is being invalidate because project 90b97e5230bb4d30a10f8314de4f4d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:16:55.836272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.837349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-287530a0-798b-4342-9385-ab22623b800b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:16:55.844318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1152/2314] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:16:55 2022] DELETE /identity/v3/projects/90b97e5230bb4d30a10f8314de4f4d42 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:55.846085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45da3-7f39-44a1-a825-68e1721e4ad9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:55.846454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45da3-7f39-44a1-a825-68e1721e4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:55.846741 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45da3-7f39-44a1-a825-68e1721e4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:55.875069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-add45da3-7f39-44a1-a825-68e1721e4ad9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:55.876758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-add45da3-7f39-44a1-a825-68e1721e4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:55.956166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1163/2315] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:55.958325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec04c0-447a-4569-82cc-305c2a767318 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:55.958911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec04c0-447a-4569-82cc-305c2a767318 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:55.958911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec04c0-447a-4569-82cc-305c2a767318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:55.980667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fdec04c0-447a-4569-82cc-305c2a767318 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:55.980872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fdec04c0-447a-4569-82cc-305c2a767318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:55.993251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1153/2316] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:16:55.994461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45da3-7f39-44a1-a825-68e1721e4ad9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:56.004557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45da3-7f39-44a1-a825-68e1721e4ad9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:56.009953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:56.010677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.011035 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.011382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.012362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:16:56.012669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:56.014305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:56.033517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1164/2317] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:16:56.035873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec04c0-447a-4569-82cc-305c2a767318 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:56.046479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec04c0-447a-4569-82cc-305c2a767318 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:56.052072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:56.054646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.054646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.054646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.054646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:56.056392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:56.090893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1154/2318] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:16:56 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:56.095237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:56.108070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bef99-6391-45b5-b895-38e4ef55c588 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:56.144761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:56.198137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:56.198857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.199146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.199427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.200320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:56.204355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:56.233966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1165/2319] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:16:56 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:16:56.238602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:56.251530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3fd4f-55e5-420a-a240-e123d42d8fe1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:56.266651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:56.267666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.268157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.268629 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.269565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:56.271407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:56.285483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1155/2320] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:56.290505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:56.303624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d81c-a3db-4cf5-b5b9-2f81d9edf398 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:56.309265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f886881-23f5-4475-afe3-a79ea617634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:56.310254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886881-23f5-4475-afe3-a79ea617634d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.310968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886881-23f5-4475-afe3-a79ea617634d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.311557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886881-23f5-4475-afe3-a79ea617634d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.312514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f886881-23f5-4475-afe3-a79ea617634d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:56.314574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f886881-23f5-4475-afe3-a79ea617634d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:56.337972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1166/2321] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:16:56.342494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:56.358652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a24a-84ab-402b-925a-6c9a7c5ac193 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:56.364066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:56.364988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.365276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.366191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] PATH_INFO: `/v3/projects/54bb3bfb06d24604ba2876cd13c74add/users/a4d85e22d87c40f5a365c873b9538668/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.395837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54bb3bfb06d24604ba2876cd13c74add, user_id=a4d85e22d87c40f5a365c873b9538668, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:56.398827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:56.430250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1156/2322] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:16:56 2022] PUT /identity/v3/projects/54bb3bfb06d24604ba2876cd13c74add/users/a4d85e22d87c40f5a365c873b9538668/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:16:56.440336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49231c7-ae90-4151-8fe7-947f93432917 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.440634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49231c7-ae90-4151-8fe7-947f93432917 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.440931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49231c7-ae90-4151-8fe7-947f93432917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.469405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f49231c7-ae90-4151-8fe7-947f93432917 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:56.471030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f49231c7-ae90-4151-8fe7-947f93432917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:56.558237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1167/2323] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:16:56.568119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:56.569886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:56.613801 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:16:56.651743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89903c06-561d-43af-b9db-b1a07a208c96 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:16:56.656187 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:16:56.656856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:56.657156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:56.657434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:56.668620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:16:56.670144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:16:56.681857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1157/2324] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:16:58.274829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe311db-beca-4c4a-84e6-d7bce82208f4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:16:58.275418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe311db-beca-4c4a-84e6-d7bce82208f4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:16:58.275418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe311db-beca-4c4a-84e6-d7bce82208f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:16:58.302312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2fe311db-beca-4c4a-84e6-d7bce82208f4 None None] MFA Rules not processed for user `629ca9989ec04405927aebcf7c3770ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:16:58.304408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2fe311db-beca-4c4a-84e6-d7bce82208f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:16:58.377461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1168/2325] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:16:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:16:59.878283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:16:59.880388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:00.013302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799a467-6f3a-4cdc-bad8-e6497e546b37 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:00.025962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:00.026853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:00.027261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:00.027744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:00.029912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:00.052560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:00.056031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:00.076469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1158/2326] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:17:01.438569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5f90e-a0af-4893-96f8-d3ae4826f38e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:01.439114 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5f90e-a0af-4893-96f8-d3ae4826f38e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:01.439237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5f90e-a0af-4893-96f8-d3ae4826f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:01.466527 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a8d5f90e-a0af-4893-96f8-d3ae4826f38e None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:01.467880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a8d5f90e-a0af-4893-96f8-d3ae4826f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:01.561844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:01.584348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1169/2327] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:01.599079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:01.601775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:01.812234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191c69-a6ab-4bcd-8079-c9ce37634c2b service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:01.828000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:01.828834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:01.829217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:01.829597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:01.840414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:01.842251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:01.853684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1159/2328] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:17:02.020660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65a6d-40dc-4426-814b-9f0fa42de397 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:02.025994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65a6d-40dc-4426-814b-9f0fa42de397 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:02.025994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65a6d-40dc-4426-814b-9f0fa42de397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:02.103148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a2f65a6d-40dc-4426-814b-9f0fa42de397 None None] MFA Rules not processed for user `a4d85e22d87c40f5a365c873b9538668`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:02.104254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2f65a6d-40dc-4426-814b-9f0fa42de397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:02.353348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1170/2329] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:02.358363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:02.376929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933803a6-3f0c-4aaa-9b9d-f76c890da1d1 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:02.392347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:02.392965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:02.393251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:02.393533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:02.394392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:02.397143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:02.443371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1160/2330] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:17:02 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:17:02.447753 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65a6d-40dc-4426-814b-9f0fa42de397 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:02.464572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65a6d-40dc-4426-814b-9f0fa42de397 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:02.588538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:02.589714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:02.595623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:02.596313 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:02.597628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:02.600814 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:02.633291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1171/2331] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:17:02 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:17:02.637286 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:02.665306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a31778-bb51-4ebd-96e9-6de0d76a760e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:02.672689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:02.673322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:02.673678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:02.674069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:02.674934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:02.677049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:02.697482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1161/2332] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:17:02.701979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:02.736093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b837af-a5e9-41f9-9854-f9cd5f77b8f0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:02.747383 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:02.748331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:02.748612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:02.748886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] PATH_INFO: `/v3/projects/e39d5ab786aa42aeb623625aaf84b7d7/users/784efbf0782f4cf3b23f5da4be83e6dc/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:02.767987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39d5ab786aa42aeb623625aaf84b7d7, user_id=784efbf0782f4cf3b23f5da4be83e6dc, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:02.775726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:02.817425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1172/2333] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:17:02 2022] PUT /identity/v3/projects/e39d5ab786aa42aeb623625aaf84b7d7/users/784efbf0782f4cf3b23f5da4be83e6dc/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:17:02.821695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:02.848971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781bca4-610f-4f01-b3e6-47fb475f5496 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:02.907588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:02.987901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf469e-4beb-4b07-ae9c-0210c41223f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:02.989137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf469e-4beb-4b07-ae9c-0210c41223f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:02.989523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf469e-4beb-4b07-ae9c-0210c41223f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:02.989881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf469e-4beb-4b07-ae9c-0210c41223f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:02.990709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf469e-4beb-4b07-ae9c-0210c41223f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:02.992432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf469e-4beb-4b07-ae9c-0210c41223f6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:03.008539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1162/2334] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:17:03.009855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:03.030639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396631e8-12bc-418f-9139-0ece391b3e5d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:03.054923 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:03.056069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:03.056435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:03.056787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] PATH_INFO: `/v3/projects/e39d5ab786aa42aeb623625aaf84b7d7/users/784efbf0782f4cf3b23f5da4be83e6dc/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:03.063167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39d5ab786aa42aeb623625aaf84b7d7, user_id=784efbf0782f4cf3b23f5da4be83e6dc, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:03.066157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:03.093632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1173/2335] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:17:03 2022] PUT /identity/v3/projects/e39d5ab786aa42aeb623625aaf84b7d7/users/784efbf0782f4cf3b23f5da4be83e6dc/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:17:09.310426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd609f-e4a7-462b-9787-e7a3b7db95c7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:09.310936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd609f-e4a7-462b-9787-e7a3b7db95c7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:09.311032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd609f-e4a7-462b-9787-e7a3b7db95c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:09.344633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-04bd609f-e4a7-462b-9787-e7a3b7db95c7 None None] MFA Rules not processed for user `784efbf0782f4cf3b23f5da4be83e6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:09.345897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-04bd609f-e4a7-462b-9787-e7a3b7db95c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:09.441079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1163/2336] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:09.457663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:09.460213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:09.572895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:09.627988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c534-818f-409f-9e32-953322d572b4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:09.635667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:09.637732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:09.638079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:09.638549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:09.773056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:09.774737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:09.790496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1174/2337] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:17:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:17:11.223690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a006e27-c7f3-4bc7-b7bf-637efcff0883 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:11.224272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a006e27-c7f3-4bc7-b7bf-637efcff0883 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:11.224905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a006e27-c7f3-4bc7-b7bf-637efcff0883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:11.245955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2a006e27-c7f3-4bc7-b7bf-637efcff0883 None None] MFA Rules not processed for user `a4d85e22d87c40f5a365c873b9538668`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:11.247332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2a006e27-c7f3-4bc7-b7bf-637efcff0883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:11.254811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1164/2338] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:19.780308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=37 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:21.239338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=57 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:39.020514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:39.022094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:39.088739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e29be-7660-4946-95e1-bddff7a15c4a service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:39.093420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:39.094343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:39.094631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:39.094908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] PATH_INFO: `/v3/users/2cca3376ce154c70a96e11d9f83984a4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:39.096116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cca3376ce154c70a96e11d9f83984a4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:39.098214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:39.146186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cca3376ce154c70a96e11d9f83984a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.158102 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cca3376ce154c70a96e11d9f83984a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.166044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cca3376ce154c70a96e11d9f83984a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.174903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cca3376ce154c70a96e11d9f83984a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.175525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cca3376ce154c70a96e11d9f83984a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.187740 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1175/2339] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:17:39 2022] DELETE /identity/v3/users/2cca3376ce154c70a96e11d9f83984a4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:17:39.192827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:39.193478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:39.193478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:39.211418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:39.212832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:39.281713 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1165/2340] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:39.291876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:39.293426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:39.353561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0734c0-e8b8-44e5-ac00-2fe9d5e6f3f2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:39.357237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb667d2-eee8-4d09-924d-3f19bba4bb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:39.357897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb667d2-eee8-4d09-924d-3f19bba4bb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:39.358200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb667d2-eee8-4d09-924d-3f19bba4bb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:39.358487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb667d2-eee8-4d09-924d-3f19bba4bb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:39.368904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb667d2-eee8-4d09-924d-3f19bba4bb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:39.370380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb667d2-eee8-4d09-924d-3f19bba4bb4b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:39.380309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1176/2341] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:17:39.685728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:39.688295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:39.700250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332429-00fe-4707-bed6-b747e45ea76d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:39.718257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:39.719240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:39.719440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:39.719722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] PATH_INFO: `/v3/projects/742db09eefa94cd492947aeb3a8a18cd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:39.721008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=742db09eefa94cd492947aeb3a8a18cd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:39.723001 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:39.792999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742db09eefa94cd492947aeb3a8a18cd', 'request_id': 'req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.804157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742db09eefa94cd492947aeb3a8a18cd', 'request_id': 'req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.811681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742db09eefa94cd492947aeb3a8a18cd', 'request_id': 'req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.824234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] The token cache is being invalidate because project 742db09eefa94cd492947aeb3a8a18cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:17:39.824521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.825328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a5e1b7b6-86c3-4526-9d9e-0a52d856b54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:17:39.826870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1166/2342] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:17:39 2022] DELETE /identity/v3/projects/742db09eefa94cd492947aeb3a8a18cd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:17:39.835439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98a049-2fab-4878-aae9-f27bde71a91c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:39.835953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98a049-2fab-4878-aae9-f27bde71a91c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:39.836720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98a049-2fab-4878-aae9-f27bde71a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:39.860335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7c98a049-2fab-4878-aae9-f27bde71a91c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:39.862532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7c98a049-2fab-4878-aae9-f27bde71a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:39.900716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:39.950439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1177/2343] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:39.959862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cb30-4e0d-4972-82c5-e9639082df22 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:39.960243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cb30-4e0d-4972-82c5-e9639082df22 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:39.960597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cb30-4e0d-4972-82c5-e9639082df22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:39.981142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e201cb30-4e0d-4972-82c5-e9639082df22 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:39.982411 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e201cb30-4e0d-4972-82c5-e9639082df22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:39.990672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1167/2344] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:39.994981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98a049-2fab-4878-aae9-f27bde71a91c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:40.005560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98a049-2fab-4878-aae9-f27bde71a91c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:40.010241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:40.010905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.011189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.011470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.012204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:17:40.012514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:40.014127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:40.026609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1178/2345] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:17:40.031012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201cb30-4e0d-4972-82c5-e9639082df22 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:40.040299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201cb30-4e0d-4972-82c5-e9639082df22 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:40.045084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:40.045745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.046028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.046334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.047026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:40.048929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:40.074790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1168/2346] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:17:40 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:17:40.079274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:40.090605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae91ae-64d3-4d07-9768-83bda5ee5fcd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:40.153333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:40.154091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.154454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.154687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.155682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:40.158261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:40.180492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1179/2347] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:17:40 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:17:40.184630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:40.196811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc2442-be29-442d-87fb-a3c80f2b8073 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:40.202030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:40.202754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.203061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.203542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.204316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:40.205897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:40.222794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1169/2348] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:17:40.223729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:40.235540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb4fe-5eba-43e9-b080-9c8a372ceef0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:40.245223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91332d-53cf-432b-8a4b-6b7cb38495d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:40.245223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91332d-53cf-432b-8a4b-6b7cb38495d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.245223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91332d-53cf-432b-8a4b-6b7cb38495d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.245223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91332d-53cf-432b-8a4b-6b7cb38495d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.245838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91332d-53cf-432b-8a4b-6b7cb38495d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:40.245838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91332d-53cf-432b-8a4b-6b7cb38495d6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:40.256728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1180/2349] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:17:40.260759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:40.272066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9564-2ee5-4fc4-ad0e-0ff57d3c6ce6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:40.277561 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:40.278502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.278788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.279059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] PATH_INFO: `/v3/projects/9b4e78c60382427d8941710d3a43e404/users/211c368f89d342418316a5bdca063e01/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.297425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4e78c60382427d8941710d3a43e404, user_id=211c368f89d342418316a5bdca063e01, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:40.300332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:40.318003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1170/2350] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:17:40 2022] PUT /identity/v3/projects/9b4e78c60382427d8941710d3a43e404/users/211c368f89d342418316a5bdca063e01/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:17:40.328806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa233-4826-4c68-bdb8-afd37f48e20e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.329064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa233-4826-4c68-bdb8-afd37f48e20e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.329378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa233-4826-4c68-bdb8-afd37f48e20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.368094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e08aa233-4826-4c68-bdb8-afd37f48e20e None None] MFA Rules not processed for user `211c368f89d342418316a5bdca063e01`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:40.369344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e08aa233-4826-4c68-bdb8-afd37f48e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:40.463242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1181/2351] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:40.478998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:17:40.483892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:40.510672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:40.554521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188d6e8-1c33-48a4-aced-5b7974ab4acf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:17:40.562620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:17:40.563621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:40.563904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:40.564184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:40.573634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:17:40.575157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:17:40.585189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1171/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:17:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:17:43.006990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfdac7-d7fc-4a24-b2f7-dd0a147b3dd1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:17:43.007492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfdac7-d7fc-4a24-b2f7-dd0a147b3dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:17:43.007589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfdac7-d7fc-4a24-b2f7-dd0a147b3dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:17:43.025971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aabfdac7-d7fc-4a24-b2f7-dd0a147b3dd1 None None] MFA Rules not processed for user `211c368f89d342418316a5bdca063e01`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:17:43.027228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aabfdac7-d7fc-4a24-b2f7-dd0a147b3dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:17:43.034153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1182/2353] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:17:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:17:50.580321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=17 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:17:53.020930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:18:21.891131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:21.892574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:21.952464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2d5a-2835-486a-ade7-66bd4f939594 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:21.956053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:21.957283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:21.957565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:21.957836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:21.959852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:22.035663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:22.037576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:22.049657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1172/2354] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:18:22.090878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfdac7-d7fc-4a24-b2f7-dd0a147b3dd1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:22.100788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfdac7-d7fc-4a24-b2f7-dd0a147b3dd1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:22.106314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:22.106981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:22.107267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:22.107549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:22.109363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:22.123808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:22.125256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:22.137493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1183/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:18:32.045051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=54 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:18:32.132289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:18:36.906605 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:36.908105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:36.922694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae85b6-4e70-4b27-aa72-f57f9bc38658 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:36.930618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:36.931285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:36.931569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:36.931847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:36.933687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:36.993719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:36.995365 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:37.006935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1173/2356] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:18:38.210619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:38.212063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:38.228024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ffe6-012e-4791-bcc3-ab80bbe6a6fc service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:38.231854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04934de5-8fa1-430f-8ef8-68b7bb5a9c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:38.232515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934de5-8fa1-430f-8ef8-68b7bb5a9c08 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:38.232802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934de5-8fa1-430f-8ef8-68b7bb5a9c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:38.233083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934de5-8fa1-430f-8ef8-68b7bb5a9c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:38.234947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04934de5-8fa1-430f-8ef8-68b7bb5a9c08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:38.294285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04934de5-8fa1-430f-8ef8-68b7bb5a9c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:38.295732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04934de5-8fa1-430f-8ef8-68b7bb5a9c08 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:38.305118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1184/2357] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:18:43.145542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:43.154712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354fd9d-c27f-47dd-a21f-595e84efd42a service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:43.158293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:43.158972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:43.159304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:43.159583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:43.161464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:43.229315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:43.231457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:43.245115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1174/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:18:46.155386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:46.155915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:46.155995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:46.182794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] MFA Rules not processed for user `b3e73f3002da4da3b94cb17f837defb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:18:46.184216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:46.192353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1185/2359] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:18:46.512982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:46.525482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494d467-54f6-4664-a233-053f40e20c4e service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:46.528980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:46.529610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:46.529909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:46.530196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:46.531969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:46.543322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:46.544751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:46.555027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1175/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:18:46.889835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:46.891395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:46.978378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e4b1d-c754-41fd-9425-4b2297d5f92a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:46.983314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18034cf-7968-49b1-8b48-ae753f79aff9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:46.983994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18034cf-7968-49b1-8b48-ae753f79aff9 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:46.984276 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18034cf-7968-49b1-8b48-ae753f79aff9 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:46.984553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18034cf-7968-49b1-8b48-ae753f79aff9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:46.986406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f18034cf-7968-49b1-8b48-ae753f79aff9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:46.998552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18034cf-7968-49b1-8b48-ae753f79aff9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:47.000167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18034cf-7968-49b1-8b48-ae753f79aff9 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:47.011416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1186/2361] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:18:51.332033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:51.345062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530af329-1dd8-47c0-b57a-7492b323b5a2 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:51.349241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:51.349903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:51.350212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:51.350503 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:51.352642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:51.363802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:51.365797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:51.375808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1176/2362] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:18:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:18:52.390826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15cfd-6356-4b09-9e1c-b7baa95ab40b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:52.391380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15cfd-6356-4b09-9e1c-b7baa95ab40b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:52.391531 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15cfd-6356-4b09-9e1c-b7baa95ab40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:52.419248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bdf15cfd-6356-4b09-9e1c-b7baa95ab40b None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:18:52.420606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bdf15cfd-6356-4b09-9e1c-b7baa95ab40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:52.494398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1187/2363] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:18:52.546273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:52.547709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:52.624889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031672-ff4a-4297-8f1b-e4cd5293e913 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:52.630931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:52.631603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:52.631888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:52.632163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:52.640930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:52.643105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:52.647747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:18:52.654354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1177/2364] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:18:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:18:53.245581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344430e-4c0d-4be3-8b1f-b43793c55276 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:53.245870 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344430e-4c0d-4be3-8b1f-b43793c55276 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:53.246148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344430e-4c0d-4be3-8b1f-b43793c55276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:53.264539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2344430e-4c0d-4be3-8b1f-b43793c55276 None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:18:53.265659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2344430e-4c0d-4be3-8b1f-b43793c55276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:53.272896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1188/2365] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jul 21 10:18:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:18:53.286020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:53.296730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c680c4-ca83-4fb2-a9ac-bd6b6457479d service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:53.302550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:53.303207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:53.303492 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:53.303772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:53.314068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:53.316354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:53.325004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1178/2366] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:18:53.543448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76437-dafc-4edb-bd69-185552d8e8ca None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:53.543912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76437-dafc-4edb-bd69-185552d8e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:53.544027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76437-dafc-4edb-bd69-185552d8e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:53.563658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c4e76437-dafc-4edb-bd69-185552d8e8ca None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:18:53.565500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c4e76437-dafc-4edb-bd69-185552d8e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:53.572780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1189/2367] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:18:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:18:53.585426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:53.598294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb59e1-b670-4c68-9e91-d661f482697d service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:53.603689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:53.604343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:53.604627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:53.604902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:53.614447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:53.616043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:53.624599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1179/2368] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:18:53.954377 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:53.954666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:53.955074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:53.972739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:18:53.973967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:18:53.982497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1190/2369] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jul 21 10:18:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:18:53.995809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:18:54.010085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbf25-0986-48e1-93ce-1bb42ceb0a0b service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:18:54.016169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:18:54.016945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:18:54.017233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:18:54.017825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:18:54.030876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:18:54.032684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:18:54.044070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1180/2370] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:19:02.538494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:19:02.539904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:19:02.551939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:19:02.559011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b4880-cebf-42c8-afef-9891a7894428 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:19:02.564874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:19:02.565537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:19:02.565824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:19:02.566104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:19:02.569463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:19:02.582676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:19:02.584284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:19:02.597400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1191/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:19:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:19:04.040102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=18 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:19:12.592500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:20:35.585674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:20:35.605382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d6ee8-92d6-4e71-b810-4ac388a4971c service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:20:35.643796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:20:35.644848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:20:35.657139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:20:35.657522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:20:35.663204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:20:35.691402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:20:35.693081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:20:35.717840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1181/2372] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:20:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:20:45.709845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:20:54.623076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:20:54.633688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c79a69-98ba-4e25-9b7e-d86adef42d41 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:20:54.637298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:20:54.637950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:20:54.638287 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:20:54.638572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:20:54.640396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:20:54.700621 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:20:54.701969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:20:54.711217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1192/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:20:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:21:04.706975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=28 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:21:45.945557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:21:45.992507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789d7c-0b9e-4029-95fa-082d1fed3a5e service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:21:45.996229 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:21:45.996878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:21:45.997160 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:21:45.997432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:21:45.999782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:21:46.078871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:21:46.080306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:21:46.089117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1182/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:21:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:21:56.085105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=50 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:22:10.323666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:22:10.394419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506c2fd-94c7-40ee-a7af-e0cac0ff5218 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:22:10.400817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:22:10.401520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:22:10.401822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:22:10.402123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:22:10.404118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:22:10.487842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:22:10.490806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:22:10.508944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1193/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:22:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:22:20.498397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=49 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:22:28.849042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:22:28.871157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddfd79-8bc8-40e8-90a4-ba5fc08823b9 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:22:28.876571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:22:28.877236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:22:28.877525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:22:28.877805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:22:28.879749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:22:28.906017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:22:28.907677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:22:28.917859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1183/2376] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:22:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:22:38.913462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=15 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:22:39.908703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:22:39.918240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bec6f-771f-4dac-8a6b-50d1e8ca247d service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:22:39.922411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:22:39.923060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:22:39.923342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:22:39.923617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:22:39.932975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:22:39.934423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:22:39.944662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1194/2377] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:22:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:22:49.940399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:23.063959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:23.082163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0773af-f804-4880-a44e-405b016f9e52 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:23.085819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:23.086597 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:23.086764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:23.087039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:23.097632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:23.099142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:23.109975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1184/2378] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:33.105318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:37.873899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:37.884125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea58239-a32a-4a71-a725-7e6c28760805 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:37.888605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:37.889246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:37.889530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:37.889806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:37.899138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:37.900559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:37.927308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1195/2379] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:39.032974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:39.043094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83244d-7233-4bec-b3a3-decb193d047d service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:39.046660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3da0f-3254-44e4-9674-d1a3373af12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:39.047297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3da0f-3254-44e4-9674-d1a3373af12c service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:39.047576 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3da0f-3254-44e4-9674-d1a3373af12c service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:39.047848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3da0f-3254-44e4-9674-d1a3373af12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:39.056466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3da0f-3254-44e4-9674-d1a3373af12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:39.057887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3da0f-3254-44e4-9674-d1a3373af12c service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:39.084626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1185/2380] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:43.639596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:43.652078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e333-897f-4223-8ae2-f3f670953632 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:43.657428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60da49f-1f3e-4e16-aef3-d7c7e40a5597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:43.658089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da49f-1f3e-4e16-aef3-d7c7e40a5597 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:43.658407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da49f-1f3e-4e16-aef3-d7c7e40a5597 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:43.658691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da49f-1f3e-4e16-aef3-d7c7e40a5597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:43.666913 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60da49f-1f3e-4e16-aef3-d7c7e40a5597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:43.668503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60da49f-1f3e-4e16-aef3-d7c7e40a5597 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:43.696385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1196/2381] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:45.367288 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005198-b7e8-4ba9-ae19-d161280d4aa5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:45.367886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005198-b7e8-4ba9-ae19-d161280d4aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:45.367886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005198-b7e8-4ba9-ae19-d161280d4aa5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:45.369201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1186/2382] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jul 21 10:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:23:45.375968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83642049-15d1-4e93-917f-4185c44a09ad None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:45.376446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83642049-15d1-4e93-917f-4185c44a09ad None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:45.376761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83642049-15d1-4e93-917f-4185c44a09ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:45.442094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-83642049-15d1-4e93-917f-4185c44a09ad None None] MFA Rules not processed for user `f1493c0e47d2452ba971464c7d0be294`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:23:45.443697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-83642049-15d1-4e93-917f-4185c44a09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:45.457852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1197/2383] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jul 21 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:23:45.481632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22005198-b7e8-4ba9-ae19-d161280d4aa5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:45.483390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-22005198-b7e8-4ba9-ae19-d161280d4aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:45.502485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22005198-b7e8-4ba9-ae19-d161280d4aa5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:45.508037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:45.508766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:45.509124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:45.509472 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:45.518420 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:45.520716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:45.531086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1187/2384] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:45.882024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83642049-15d1-4e93-917f-4185c44a09ad None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:45.891345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83642049-15d1-4e93-917f-4185c44a09ad None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:45.894935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:45.895573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:45.895853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:45.896127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:45.898028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:45.983432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:45.985569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:46.005709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1198/2385] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:49.274457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:49.294886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdc6b-2655-42f9-8d77-b8c081e3fc44 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:49.304082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:49.305706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:49.306211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:49.307969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:49.310813 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:49.325118 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:49.326843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:49.337948 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1188/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:52.246778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:52.265520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f1947-dd63-4c82-bbc4-e378a7775f66 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:52.273759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:52.274678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:52.275125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:52.275604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:52.277520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:52.296105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:52.298754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:52.323603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1199/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:52.329477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:52.331599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:52.354122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25238ec-2216-4b43-907c-c7851d4b5e3b service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:52.359242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:52.360224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:52.360511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:52.360791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] PATH_INFO: `/v3/users/a4d85e22d87c40f5a365c873b9538668` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:52.362004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d85e22d87c40f5a365c873b9538668)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:52.365289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:52.414771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d85e22d87c40f5a365c873b9538668'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:52.415450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d85e22d87c40f5a365c873b9538668'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:52.423161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d85e22d87c40f5a365c873b9538668'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:52.423834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d85e22d87c40f5a365c873b9538668'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:52.431990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d85e22d87c40f5a365c873b9538668'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:52.452436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1189/2388] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:23:52 2022] DELETE /identity/v3/users/a4d85e22d87c40f5a365c873b9538668 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:23:52.869903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:52.882370 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d9f36-db3e-45f0-9a30-be290ec7202f service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:52.896150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:52.946473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:52.947768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:52.948195 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:52.948616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] PATH_INFO: `/v3/projects/54bb3bfb06d24604ba2876cd13c74add` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:52.950466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54bb3bfb06d24604ba2876cd13c74add)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:52.953458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:53.011184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54bb3bfb06d24604ba2876cd13c74add', 'request_id': 'req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.017139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54bb3bfb06d24604ba2876cd13c74add', 'request_id': 'req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.023246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54bb3bfb06d24604ba2876cd13c74add', 'request_id': 'req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.034679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] The token cache is being invalidate because project 54bb3bfb06d24604ba2876cd13c74add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:23:53.034964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.035580 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.037110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1200/2389] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:23:52 2022] DELETE /identity/v3/projects/54bb3bfb06d24604ba2876cd13c74add => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:23:53.041121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:53.042664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:53.055982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae5d5c-dcf7-403e-b4a6-c6bbfe5e1181 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:53.114643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:53.115654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.115931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.116201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] PATH_INFO: `/v3/users/784efbf0782f4cf3b23f5da4be83e6dc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.117381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] RBAC: Authorizing `identity:delete_user(user_id=784efbf0782f4cf3b23f5da4be83e6dc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:53.119330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:53.140263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:53.166494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784efbf0782f4cf3b23f5da4be83e6dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.167139 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784efbf0782f4cf3b23f5da4be83e6dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.173927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784efbf0782f4cf3b23f5da4be83e6dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.174578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784efbf0782f4cf3b23f5da4be83e6dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.181598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-32cd1440-c077-4ec2-ac0a-9801a1d791da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784efbf0782f4cf3b23f5da4be83e6dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.199036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1190/2390] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:23:53 2022] DELETE /identity/v3/users/784efbf0782f4cf3b23f5da4be83e6dc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:23:53.401537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:53.403631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:53.417587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcd9b9-b177-48d2-8e90-60edaac9cc2c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:53.493687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:53.494617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.494904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.495185 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] PATH_INFO: `/v3/projects/e39d5ab786aa42aeb623625aaf84b7d7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.496631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39d5ab786aa42aeb623625aaf84b7d7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:53.498345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:53.545681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39d5ab786aa42aeb623625aaf84b7d7', 'request_id': 'req-8cd12c29-67e3-45b1-981e-0561ab3888d2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.546805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:53.553935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39d5ab786aa42aeb623625aaf84b7d7', 'request_id': 'req-8cd12c29-67e3-45b1-981e-0561ab3888d2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.560396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39d5ab786aa42aeb623625aaf84b7d7', 'request_id': 'req-8cd12c29-67e3-45b1-981e-0561ab3888d2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.572871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] The token cache is being invalidate because project e39d5ab786aa42aeb623625aaf84b7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:23:53.573168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.573781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8cd12c29-67e3-45b1-981e-0561ab3888d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:23:53.575372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1201/2391] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:23:53 2022] DELETE /identity/v3/projects/e39d5ab786aa42aeb623625aaf84b7d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:23:53.580368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbba73-6cea-4528-bf7b-00c551dde5fc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.580874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbba73-6cea-4528-bf7b-00c551dde5fc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.580976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbba73-6cea-4528-bf7b-00c551dde5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.626498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1ccbba73-6cea-4528-bf7b-00c551dde5fc None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:23:53.627796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1ccbba73-6cea-4528-bf7b-00c551dde5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:53.695975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1191/2392] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:23:53.704274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58213-fd83-43a0-9cf0-c9972bb9ad68 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.704502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58213-fd83-43a0-9cf0-c9972bb9ad68 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.704790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58213-fd83-43a0-9cf0-c9972bb9ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.723450 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1da58213-fd83-43a0-9cf0-c9972bb9ad68 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:23:53.724660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1da58213-fd83-43a0-9cf0-c9972bb9ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:53.733058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1202/2393] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:23:53.737063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbba73-6cea-4528-bf7b-00c551dde5fc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:53.747307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbba73-6cea-4528-bf7b-00c551dde5fc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:53.751975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:53.752639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.752925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.753195 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.753927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:23:53.754248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:53.755845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:53.781363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1192/2394] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:23:53.786130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da58213-fd83-43a0-9cf0-c9972bb9ad68 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:53.795566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da58213-fd83-43a0-9cf0-c9972bb9ad68 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:53.800821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:53.801483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.801772 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.802055 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.802990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:53.807057 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:53.842449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1203/2395] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:23:53 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:23:53.847034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:53.857129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a1464-ba45-4870-976f-9716b7c2c904 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:53.912416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:53.913107 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.913389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.913659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.914361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:53.916266 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:53.923564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:53.937798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1193/2396] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:23:53 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:23:53.941929 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:53.952173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae568-2b46-47dc-b78a-ae7c3b8406c6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:53.956876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:53.957475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.957760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.958039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.958818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:53.960407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:53.970180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1204/2397] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:23:53.974435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:53.984741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c418-c343-49aa-a1e7-6d77fcf16d5a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:53.990087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8e0b-8838-44f6-b760-0884eb56d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:53.990777 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8e0b-8838-44f6-b760-0884eb56d05c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:53.991061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8e0b-8838-44f6-b760-0884eb56d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:53.991336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8e0b-8838-44f6-b760-0884eb56d05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:53.992063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b8e0b-8838-44f6-b760-0884eb56d05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:53.993646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b8e0b-8838-44f6-b760-0884eb56d05c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:54.005388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1194/2398] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:23:54.009451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:54.019865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1efcc-7da2-472f-a61c-1b78291dbb6c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:54.025061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:54.025981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:54.026298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:54.026578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] PATH_INFO: `/v3/projects/8f52b214b1024e3a8adf81d2efd68eef/users/560abc0036ba4a9eb7e53ecc0930afe1/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:54.042030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f52b214b1024e3a8adf81d2efd68eef, user_id=560abc0036ba4a9eb7e53ecc0930afe1, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:54.044702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:54.056827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1205/2399] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:23:54 2022] PUT /identity/v3/projects/8f52b214b1024e3a8adf81d2efd68eef/users/560abc0036ba4a9eb7e53ecc0930afe1/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:23:54.061775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3b7b-7094-4383-982f-bf7019858651 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:54.062065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3b7b-7094-4383-982f-bf7019858651 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:54.062375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3b7b-7094-4383-982f-bf7019858651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:54.078955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a03d3b7b-7094-4383-982f-bf7019858651 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:23:54.080157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a03d3b7b-7094-4383-982f-bf7019858651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:54.138851 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1195/2400] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:23:54.149224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:54.150936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:54.218852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bffee8-d78e-4b97-b9e9-c02cc8be4314 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:54.223205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:54.223855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:54.224144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:54.224426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:54.233716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:54.235175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:54.244624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1206/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:23:58.161182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cef8a-e6df-4399-87a7-640af540777e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:58.161748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cef8a-e6df-4399-87a7-640af540777e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:58.161748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cef8a-e6df-4399-87a7-640af540777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:58.212798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5b4cef8a-e6df-4399-87a7-640af540777e None None] MFA Rules not processed for user `560abc0036ba4a9eb7e53ecc0930afe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:23:58.214016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b4cef8a-e6df-4399-87a7-640af540777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:23:58.368253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1196/2402] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:23:58.373149 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:58.385832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad54cd-dac9-4fed-9b50-fe6d331e9adf service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:58.399097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:58.399785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:58.400073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:58.400356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:58.401080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:58.406598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:58.473153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1207/2403] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:23:58 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:23:58.477424 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cef8a-e6df-4399-87a7-640af540777e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:58.494190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cef8a-e6df-4399-87a7-640af540777e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:58.597217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:58.597918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:58.598231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:58.598515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:58.599446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:58.601404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:58.620066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:58.628323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1197/2404] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:23:58 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:23:58.632196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:58.644120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2945b7-9f76-4d80-8364-2669c67b59d1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:58.649169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:58.649881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:58.650163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:58.650473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:58.651234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:58.652868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:58.664296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1208/2405] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:23:58.668830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:58.679193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb022-3bde-4940-a8dc-b3e57ef1fb94 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:58.685661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:58.686621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:58.686906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:58.687182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] PATH_INFO: `/v3/projects/b8c36a28c03142ba9bbc69cae73bfd53/users/1cd6a8b86d834df6992a1916ed7e07ad/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:58.704592 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c36a28c03142ba9bbc69cae73bfd53, user_id=1cd6a8b86d834df6992a1916ed7e07ad, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:58.708581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:58.727516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1198/2406] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:23:58 2022] PUT /identity/v3/projects/b8c36a28c03142ba9bbc69cae73bfd53/users/1cd6a8b86d834df6992a1916ed7e07ad/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:23:58.731194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:58.750338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e4265-aefe-4675-bb29-bab1aaf0e5ae admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:58.780941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:23:58.828551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:58.829261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:58.829549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:58.829857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:58.831145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:58.832830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:58.843294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1209/2407] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:23:58.848271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:23:58.859322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b66abc-1b25-4f67-846b-acc3813e1a0f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:23:58.864023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50d56b-4911-4e32-89f2-9f48dd588b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:23:58.865109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d56b-4911-4e32-89f2-9f48dd588b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:23:58.865388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d56b-4911-4e32-89f2-9f48dd588b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:23:58.865659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d56b-4911-4e32-89f2-9f48dd588b4e admin admin] PATH_INFO: `/v3/projects/b8c36a28c03142ba9bbc69cae73bfd53/users/1cd6a8b86d834df6992a1916ed7e07ad/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:23:58.867877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50d56b-4911-4e32-89f2-9f48dd588b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c36a28c03142ba9bbc69cae73bfd53, user_id=1cd6a8b86d834df6992a1916ed7e07ad, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:23:58.870609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50d56b-4911-4e32-89f2-9f48dd588b4e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:23:58.882347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1199/2408] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:23:58 2022] PUT /identity/v3/projects/b8c36a28c03142ba9bbc69cae73bfd53/users/1cd6a8b86d834df6992a1916ed7e07ad/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:24:00.884953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:01.014459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409a05-92e6-4b49-a1fb-5b9692f90be2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:01.094387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:01.095068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:01.095358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:01.095645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:01.098255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:01.253010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:01.255380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:01.277832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1210/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:24:05.083098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ef3c-e9e4-46ce-9b3c-fa3dcd53ff27 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:05.083786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ef3c-e9e4-46ce-9b3c-fa3dcd53ff27 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:05.083786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ef3c-e9e4-46ce-9b3c-fa3dcd53ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:05.124431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c619ef3c-e9e4-46ce-9b3c-fa3dcd53ff27 None None] MFA Rules not processed for user `1cd6a8b86d834df6992a1916ed7e07ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:24:05.125673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c619ef3c-e9e4-46ce-9b3c-fa3dcd53ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:05.245866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:05.247549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:05.257150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1200/2410] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:24:05.263724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee8ef-5679-4e96-9259-02ce47c4a29f service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:05.271068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:05.271946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:05.272393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:05.272830 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:05.277962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:24:05.347510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:05.349538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:05.362773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1211/2411] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:24:05.503247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:05.503535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:05.505873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:05.553429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] MFA Rules not processed for user `cb3146ed5b1947ee99cba2e95a777a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:24:05.554716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:05.652664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1201/2412] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:24:06.074087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:06.094141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a131c5b-25ba-46fb-8890-b8d03662105f service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:06.106854 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:06.108069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:06.108540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:06.109141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:06.117435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:06.133878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:06.135906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:06.154355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1212/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:24:06.576473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:06.578541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:06.630822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:24:06.677568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a61c4f-6608-4658-8cce-956f15c9b010 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:06.683530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:06.684376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:06.684729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:06.685070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:06.687061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:06.700274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:06.702433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:06.713850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1202/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:24:09.271881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:09.282063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8660f-9c61-496c-8f41-2f03147418a9 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:09.291720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:09.292399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:09.292685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:09.293093 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:09.294982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:09.307650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:09.309177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:09.320956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1213/2415] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:24:16.709590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=16 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:24:18.522477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:18.524539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:18.543210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450da905-f0c6-4e49-8e90-9a4dfab2b98b service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:18.548866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976a4b-e2dd-43df-9c13-df97c0eac189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:18.549549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976a4b-e2dd-43df-9c13-df97c0eac189 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:18.549843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976a4b-e2dd-43df-9c13-df97c0eac189 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:18.550119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976a4b-e2dd-43df-9c13-df97c0eac189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:18.551959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e8976a4b-e2dd-43df-9c13-df97c0eac189 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:18.572691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8976a4b-e2dd-43df-9c13-df97c0eac189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:18.572691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8976a4b-e2dd-43df-9c13-df97c0eac189 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:18.579335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1203/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:24:19.316822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=37 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:24:28.575232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:24:55.957176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:55.959134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:56.025674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d08a5-6afe-49a4-b946-ee93299d6473 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.030084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.030989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.031279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.031559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] PATH_INFO: `/v3/users/211c368f89d342418316a5bdca063e01` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.032764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=211c368f89d342418316a5bdca063e01)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.034699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.081436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211c368f89d342418316a5bdca063e01'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.093681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211c368f89d342418316a5bdca063e01'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.101025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211c368f89d342418316a5bdca063e01'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.107862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211c368f89d342418316a5bdca063e01'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.108611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211c368f89d342418316a5bdca063e01'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.114903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1214/2417] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:24:55 2022] DELETE /identity/v3/users/211c368f89d342418316a5bdca063e01 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:24:56.119386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.119925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.119925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.136718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:24:56.137895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:56.196707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1204/2418] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:24:56.206260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.208286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:56.264949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fa9dc-55bc-40d3-889f-c3d1d6591f6a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.268733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a113a-38c4-479b-8971-3377a5d0e0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.269379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a113a-38c4-479b-8971-3377a5d0e0ce service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.269666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a113a-38c4-479b-8971-3377a5d0e0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.270697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a113a-38c4-479b-8971-3377a5d0e0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.279755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a113a-38c4-479b-8971-3377a5d0e0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.281120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a113a-38c4-479b-8971-3377a5d0e0ce service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.291236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1215/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:24:56.459073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.460591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:56.472731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e257893-ca9a-4631-8da4-d0c962aeb996 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.478467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.479327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.479608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.479883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] PATH_INFO: `/v3/projects/9b4e78c60382427d8941710d3a43e404` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.481078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4e78c60382427d8941710d3a43e404)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.483002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.533396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4e78c60382427d8941710d3a43e404', 'request_id': 'req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.540878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4e78c60382427d8941710d3a43e404', 'request_id': 'req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.546728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4e78c60382427d8941710d3a43e404', 'request_id': 'req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.558116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] The token cache is being invalidate because project 9b4e78c60382427d8941710d3a43e404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:24:56.558434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.559062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-20a16ad8-28a5-4fdf-b8f0-f8e02ec803d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:24:56.560604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1205/2420] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:24:56 2022] DELETE /identity/v3/projects/9b4e78c60382427d8941710d3a43e404 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:24:56.566822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92de6-2c14-4bc4-b60f-ff0647f7859c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.567116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92de6-2c14-4bc4-b60f-ff0647f7859c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.567402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92de6-2c14-4bc4-b60f-ff0647f7859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.584997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7db92de6-2c14-4bc4-b60f-ff0647f7859c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:24:56.586239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7db92de6-2c14-4bc4-b60f-ff0647f7859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:56.607386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:24:56.653145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1216/2421] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:24:56.661319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd784b-5e9c-4e04-af50-c1fccd3e1493 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.661614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd784b-5e9c-4e04-af50-c1fccd3e1493 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.661915 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd784b-5e9c-4e04-af50-c1fccd3e1493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.680298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-91dd784b-5e9c-4e04-af50-c1fccd3e1493 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:24:56.681499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-91dd784b-5e9c-4e04-af50-c1fccd3e1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:56.689718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1206/2422] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:24:56.693868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92de6-2c14-4bc4-b60f-ff0647f7859c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.703598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92de6-2c14-4bc4-b60f-ff0647f7859c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.708779 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.709426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.709709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.709988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.710734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:24:56.711042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.712634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.724647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1217/2423] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:24:56.729019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd784b-5e9c-4e04-af50-c1fccd3e1493 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.738102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd784b-5e9c-4e04-af50-c1fccd3e1493 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.742901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.743547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.743829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.744101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.744794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.746790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.772843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1207/2424] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:24:56 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:24:56.776957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.787637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564630cb-6ccd-4970-be30-6d6bdc46d8dc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.844776 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.845456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.845742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.846022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.846825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.849315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.868687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1218/2425] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:24:56 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:24:56.872825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.883012 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177714-1502-444f-8027-de9a4f669d07 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.887668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.888331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.888672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.888959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.889684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.891313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.906224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1208/2426] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:24:56.907657 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.918698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c57a-c51c-4bdb-b9c8-e13299405e48 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.923362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560541-f419-4cc2-813f-e6fc7b37ab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.924021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560541-f419-4cc2-813f-e6fc7b37ab06 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.924309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560541-f419-4cc2-813f-e6fc7b37ab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.924613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560541-f419-4cc2-813f-e6fc7b37ab06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.925317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85560541-f419-4cc2-813f-e6fc7b37ab06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.927115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85560541-f419-4cc2-813f-e6fc7b37ab06 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.946128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1219/2427] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:24:56.950244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:56.960758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff37a64-eb5b-4138-b615-bdabe5a227c1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:56.965447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:56.966366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:56.966651 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:56.967048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] PATH_INFO: `/v3/projects/538b3780ca5c4043950ca415b9308567/users/c1322247e66e4061b09993b3e0a2725f/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:56.982766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=538b3780ca5c4043950ca415b9308567, user_id=c1322247e66e4061b09993b3e0a2725f, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:56.985414 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:56.999178 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1209/2428] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:24:56 2022] PUT /identity/v3/projects/538b3780ca5c4043950ca415b9308567/users/c1322247e66e4061b09993b3e0a2725f/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:24:57.009317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b0eb4-42c3-45a6-af43-8228debda3ae None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:57.009784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b0eb4-42c3-45a6-af43-8228debda3ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:57.009882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b0eb4-42c3-45a6-af43-8228debda3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:57.039907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-431b0eb4-42c3-45a6-af43-8228debda3ae None None] MFA Rules not processed for user `c1322247e66e4061b09993b3e0a2725f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:24:57.041212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-431b0eb4-42c3-45a6-af43-8228debda3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:57.104012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1220/2429] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:24:57.115105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:24:57.116804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:24:57.139785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:24:57.186491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d3e5-3ac5-402c-9c3e-3c4934ff455b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:24:57.190106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:24:57.190794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:24:57.191081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:24:57.191355 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:24:57.199587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:24:57.201007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:24:57.209926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1210/2430] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:24:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:25:07.100904 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:25:07.205718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=22 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:25:54.861598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b0eb4-42c3-45a6-af43-8228debda3ae None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:25:54.872040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b0eb4-42c3-45a6-af43-8228debda3ae None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:25:54.875634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:25:54.876274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:25:54.876558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:25:54.876834 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:25:54.878637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:25:54.958811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:25:54.960253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:25:54.979884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1221/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:25:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:26:04.976374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=41 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:26:46.711968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:46.713524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:26:46.724920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eb1a4-aa8b-4f02-b948-974cd7af3038 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:26:46.729396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:26:46.730037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:46.730362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:46.730640 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:46.732399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:26:46.810722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:26:46.812201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:26:46.829907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1211/2432] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:26:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:26:56.827221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=41 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:32.785298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.786815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:32.859873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df6242-e24a-4fb1-bbe2-823b52fcb64c service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.864996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.865684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.865972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.866282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.868079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:32.879931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:32.881517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:32.892015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1222/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:27:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:27:42.887788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=32 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.419123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.427808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093c238-ccc7-4dcb-b28b-9d259a21d6df service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.431714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.432361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.432645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.432921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.434763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:36.504842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.506333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.515464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1212/2434] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:28:37.607299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.616700 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0a94f-9914-49cb-9246-8135935929f3 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.621038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.621676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.621960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.622264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.624020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:37.685214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.686734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.695724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1223/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:28:42.992674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:43.001296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2d8ce-4b34-4b93-aa0c-6c1bf35c1466 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:43.004866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:43.005505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:43.005789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:43.006064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:43.007845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:43.077004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:43.078376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:43.087901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1213/2436] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:28:47.691516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=28 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:53.083091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=66 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:05.828177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:05.836724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b594c2-51d8-41be-85e6-13cc90fee553 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:05.840343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:05.840984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:05.841271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:05.841546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:05.843321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:05.900988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:05.902435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:05.911358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1224/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:15.907186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=28 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:34.443536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:34.445023 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:34.508111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca6fc0-6cb9-4a73-b8fd-2303ae6d3d41 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:34.512390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:34.513047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:34.513328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:34.513601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:34.515377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:34.524853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:34.527090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:34.534953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1214/2438] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:44.531397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=26 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:47.209260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:47.219615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd7fab-45ee-413b-9ec4-8db6d2cdc1da service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:47.223323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:47.224043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:47.224327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:47.224604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:47.226546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:47.299336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:47.300777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:47.311891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1225/2439] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:48.490482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:48.502930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01233-8e69-4cdd-b551-38363d8e42f9 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:48.506849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e730328-19ae-455b-b333-36061745d24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:48.507496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730328-19ae-455b-b333-36061745d24b service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:48.507779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730328-19ae-455b-b333-36061745d24b service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:48.508058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730328-19ae-455b-b333-36061745d24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:48.509859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8e730328-19ae-455b-b333-36061745d24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:48.526284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e730328-19ae-455b-b333-36061745d24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:48.527827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e730328-19ae-455b-b333-36061745d24b service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:48.540240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1215/2440] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:29:48.778033 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:48.780179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:48.798709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e2e4-4ba5-4f53-a7a6-96f6902247e6 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:48.805744 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:48.806532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:48.806983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:48.807348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:48.809751 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:48.824642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:48.826615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:48.839811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1226/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:50.976403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:50.977117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:50.977339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:51.028914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] MFA Rules not processed for user `91369e2de7944f68acbaff6d5f8c28ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:51.030190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:51.095499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1216/2442] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jul 21 10:29:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:29:51.142836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:51.144237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:51.236606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c4f4d-682d-4755-86ed-17b54d2f0a4d service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:51.251557 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72498fa7138e4308affc50fa1b1a78fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:51.252248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:51.252532 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:51.252810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:51.261476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:51.263135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:51.271281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1227/2443] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jul 21 10:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:29:51.753789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:51.756077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:51.770920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9dbb2-1ee3-4d8c-9b24-302c26fc9166 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:51.775141 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:51.775868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:51.776906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:51.777245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:51.779121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:51.852210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:51.853648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:51.863554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1217/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:55.091452 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:55.103027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efca608-9ad2-44b8-ade8-248034b3b5da service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:55.108733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:55.109507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:55.109896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:55.110323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:55.112226 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:55.124342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:55.126027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:55.138496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1228/2445] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:57.544782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:57.552066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90944725-2513-495b-8585-e5651ce1d174 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:57.555662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:57.556316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:57.556598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:57.556879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:57.566192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:57.567633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:57.578135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1218/2446] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:58.590836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:58.607552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e337c3-6c00-4105-a728-c44b500e1641 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:58.613620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:58.614491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:58.614785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:58.615126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:58.617043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:58.634595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:58.638123 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:58.664143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:58.670859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:58.683725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73078ff-1f10-422d-af7f-ab45b93161fa service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:58.685782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1229/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:29:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:29:58.689665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:58.690579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:58.690885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:58.691173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] PATH_INFO: `/v3/users/629ca9989ec04405927aebcf7c3770ef` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:58.693231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=629ca9989ec04405927aebcf7c3770ef)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:58.695665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:58.755809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:58.767391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629ca9989ec04405927aebcf7c3770ef'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:58.768918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629ca9989ec04405927aebcf7c3770ef'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:58.779643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629ca9989ec04405927aebcf7c3770ef'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:58.779643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629ca9989ec04405927aebcf7c3770ef'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:58.790352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629ca9989ec04405927aebcf7c3770ef'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:58.809933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1219/2448] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:29:58 2022] DELETE /identity/v3/users/629ca9989ec04405927aebcf7c3770ef => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:29:58.994408 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:59.006278 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c57a0-9da9-4ff1-872a-c4993951b092 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:59.020837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:59.075413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:59.076296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:59.076579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:59.076861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] PATH_INFO: `/v3/projects/f9d14cb301204ac786d97cc954ed4e27` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:59.078077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d14cb301204ac786d97cc954ed4e27)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:59.080078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:59.127997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d14cb301204ac786d97cc954ed4e27', 'request_id': 'req-86cc7253-de96-4095-9b9c-a07cb1e1d630'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.134207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d14cb301204ac786d97cc954ed4e27', 'request_id': 'req-86cc7253-de96-4095-9b9c-a07cb1e1d630'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.140852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d14cb301204ac786d97cc954ed4e27', 'request_id': 'req-86cc7253-de96-4095-9b9c-a07cb1e1d630'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.154403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] The token cache is being invalidate because project f9d14cb301204ac786d97cc954ed4e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:29:59.154814 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.155448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.157000 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1230/2449] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:29:58 2022] DELETE /identity/v3/projects/f9d14cb301204ac786d97cc954ed4e27 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:29:59.161416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:59.162874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:59.178675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a81d8-6cee-4940-b2c4-85264826cbfb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:59.242308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:59.243174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:59.243459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:59.243737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] PATH_INFO: `/v3/users/8ca794815ffe464d999261bb7e5a404b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:59.257732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca794815ffe464d999261bb7e5a404b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:59.260026 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:59.308538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca794815ffe464d999261bb7e5a404b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.309253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca794815ffe464d999261bb7e5a404b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.316518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca794815ffe464d999261bb7e5a404b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.317247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca794815ffe464d999261bb7e5a404b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.324210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca794815ffe464d999261bb7e5a404b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.341946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1220/2450] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:29:59 2022] DELETE /identity/v3/users/8ca794815ffe464d999261bb7e5a404b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:29:59.513831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:59.515345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:59.533378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc7253-de96-4095-9b9c-a07cb1e1d630 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:59.591997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:59.592845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:59.593129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:59.593407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] PATH_INFO: `/v3/projects/6c76c23c0b7b4601b0f8df89f7695c47` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:59.604809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c76c23c0b7b4601b0f8df89f7695c47)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:59.606777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:59.651457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:59.660315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c76c23c0b7b4601b0f8df89f7695c47', 'request_id': 'req-f12611b0-2a0e-493d-834a-5c5467065790'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.667645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c76c23c0b7b4601b0f8df89f7695c47', 'request_id': 'req-f12611b0-2a0e-493d-834a-5c5467065790'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.674257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c76c23c0b7b4601b0f8df89f7695c47', 'request_id': 'req-f12611b0-2a0e-493d-834a-5c5467065790'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.687191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] The token cache is being invalidate because project 6c76c23c0b7b4601b0f8df89f7695c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:29:59.687537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.688181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:29:59.690004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1231/2451] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:29:59 2022] DELETE /identity/v3/projects/6c76c23c0b7b4601b0f8df89f7695c47 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:30:09.337895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=74,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:09.683808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:55.167310 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:55.168782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:55.244110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036123d1-1ee3-4242-b4dd-9d90d08207ac admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:55.308982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598088-d0c5-4342-aabb-14e465befb20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:55.309634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598088-d0c5-4342-aabb-14e465befb20 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:55.309914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598088-d0c5-4342-aabb-14e465befb20 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:55.310219 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598088-d0c5-4342-aabb-14e465befb20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:55.318957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67598088-d0c5-4342-aabb-14e465befb20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:55.376938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598088-d0c5-4342-aabb-14e465befb20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:55.378575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598088-d0c5-4342-aabb-14e465befb20 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:55.388082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1221/2452] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:30:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:30:57.451250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:57.452686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:57.516448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12611b0-2a0e-493d-834a-5c5467065790 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:57.521125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:57.521999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:57.522319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:57.522599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] PATH_INFO: `/v3/users/c1322247e66e4061b09993b3e0a2725f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:57.523810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1322247e66e4061b09993b3e0a2725f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:57.525797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:57.575283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1322247e66e4061b09993b3e0a2725f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:57.586964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1322247e66e4061b09993b3e0a2725f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:57.594246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1322247e66e4061b09993b3e0a2725f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:57.602039 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1322247e66e4061b09993b3e0a2725f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:57.602702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1322247e66e4061b09993b3e0a2725f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:57.608627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1232/2453] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:30:57 2022] DELETE /identity/v3/users/c1322247e66e4061b09993b3e0a2725f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:30:57.613271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:57.613752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:57.613864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:57.631019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:30:57.632217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:57.664591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:57.696822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1222/2454] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:30:57.707005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:57.708435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:57.766130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59877a-f1a3-4f52-97a2-2eeb8bf91938 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:57.769810 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d71fd-ed63-42e9-89d5-2fd4fd66ddd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:57.770500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d71fd-ed63-42e9-89d5-2fd4fd66ddd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:57.770785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d71fd-ed63-42e9-89d5-2fd4fd66ddd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:57.771067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d71fd-ed63-42e9-89d5-2fd4fd66ddd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:57.780248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d71fd-ed63-42e9-89d5-2fd4fd66ddd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:57.781664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d71fd-ed63-42e9-89d5-2fd4fd66ddd1 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:57.791347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1233/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:30:58.067511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.068960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:58.080638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e7fa9-6f25-49a0-92f2-fb7a44aeaf32 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.085281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.087242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.087538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.087816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] PATH_INFO: `/v3/projects/538b3780ca5c4043950ca415b9308567` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.089019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538b3780ca5c4043950ca415b9308567)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.091812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.142341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538b3780ca5c4043950ca415b9308567', 'request_id': 'req-1e3b97f2-ffbf-4bee-b251-d784a4252191'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:58.149689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538b3780ca5c4043950ca415b9308567', 'request_id': 'req-1e3b97f2-ffbf-4bee-b251-d784a4252191'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:58.155660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538b3780ca5c4043950ca415b9308567', 'request_id': 'req-1e3b97f2-ffbf-4bee-b251-d784a4252191'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:58.167013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] The token cache is being invalidate because project 538b3780ca5c4043950ca415b9308567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:30:58.167302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:58.167939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1e3b97f2-ffbf-4bee-b251-d784a4252191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:30:58.169480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1223/2456] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:30:58 2022] DELETE /identity/v3/projects/538b3780ca5c4043950ca415b9308567 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:30:58.176077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861186f-15cf-4f3b-bd19-b52f72288c72 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.176374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861186f-15cf-4f3b-bd19-b52f72288c72 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.176660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861186f-15cf-4f3b-bd19-b52f72288c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.194656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0861186f-15cf-4f3b-bd19-b52f72288c72 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:30:58.195874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0861186f-15cf-4f3b-bd19-b52f72288c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:58.212268 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:58.258100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1234/2457] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:30:58.265778 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb20bd-c2b8-4d16-aacf-7045cebac0a3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.266072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb20bd-c2b8-4d16-aacf-7045cebac0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.266381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb20bd-c2b8-4d16-aacf-7045cebac0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.285292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-63bb20bd-c2b8-4d16-aacf-7045cebac0a3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:30:58.286508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63bb20bd-c2b8-4d16-aacf-7045cebac0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:58.294994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1224/2458] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:30:58.299050 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861186f-15cf-4f3b-bd19-b52f72288c72 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.309488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861186f-15cf-4f3b-bd19-b52f72288c72 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.314127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.314819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.315131 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.315411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.316144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:30:58.316454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.318048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.329411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1235/2459] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:58.333403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb20bd-c2b8-4d16-aacf-7045cebac0a3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.342450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb20bd-c2b8-4d16-aacf-7045cebac0a3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.347042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.347682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.347964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.348238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.348937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.350860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.380279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1225/2460] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:30:58 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:30:58.384024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.394994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73530d-9881-4c8f-8b74-1ad092a31ac7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.451869 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.452546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.452809 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.453122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.453812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.455762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.477023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1236/2461] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:30:58 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:30:58.483136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.493343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08781-1611-4f4f-b671-e50e5da1b908 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.498120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.498824 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.499093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.499358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.500086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.501689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.512212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1226/2462] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:30:58.516167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.526656 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac3b4-6566-4b73-a64d-59eb98bf6e56 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.531295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67657724-4a9d-476b-93cc-ae2616e36c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.531953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657724-4a9d-476b-93cc-ae2616e36c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.532238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657724-4a9d-476b-93cc-ae2616e36c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.532513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657724-4a9d-476b-93cc-ae2616e36c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.533271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67657724-4a9d-476b-93cc-ae2616e36c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.534896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67657724-4a9d-476b-93cc-ae2616e36c1e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.545296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1237/2463] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:30:58.549199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.558985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143d838-a96a-46da-a3ef-ae9a6b26b653 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.563859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.564869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.565148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.565416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] PATH_INFO: `/v3/projects/82a87837cf7b437aa71a12ea126d623e/users/1670f9cffa264167bed8dd590d5d9db7/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.580529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a87837cf7b437aa71a12ea126d623e, user_id=1670f9cffa264167bed8dd590d5d9db7, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.583262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.598554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1227/2464] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:30:58 2022] PUT /identity/v3/projects/82a87837cf7b437aa71a12ea126d623e/users/1670f9cffa264167bed8dd590d5d9db7/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:30:58.610856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.611154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.611440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.638672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] MFA Rules not processed for user `1670f9cffa264167bed8dd590d5d9db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:30:58.639886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:58.703824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1238/2465] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:30:58.734817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:58.736594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:58.792931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d4371-dd79-4bc7-a6dd-25bfeb05ea80 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:58.796526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:58.797166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:58.797444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:58.797719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:58.806037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:58.807622 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:58.811047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:58.818932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1228/2466] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:30:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:31:08.700689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:08.819823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:38.435274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:38.444972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:38.538470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d08b6f-9b77-4246-91b1-c7784653dd2d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:38.544660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:38.545598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:38.545839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:38.546120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:38.548172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:38.561483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:38.563309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:38.575378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1239/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:31:48.571098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=34 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:32:38.350264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:32:38.352383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:32:38.567967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47963a-0f4d-4b1c-bbae-982925f0cc1b service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:32:38.573913 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:32:38.574773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:32:38.575059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:32:38.575465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:32:38.582563 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:32:38.594642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:32:38.596231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:32:38.607516 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1229/2468] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:32:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:32:48.603250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=63 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:33:37.083012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:33:37.084434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:33:37.135456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce323ee-2a4b-4a38-9166-52c3a9e0e351 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:33:37.139110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:33:37.140399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:33:37.140709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:33:37.141047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:33:37.142856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:33:37.212390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:33:37.213827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:33:37.223617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1240/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:33:38.316015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:33:38.325593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4485f02-8b36-463f-be51-c2c331d88cba service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:33:38.331267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:33:38.331961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:33:38.332247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:33:38.332522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:33:38.334374 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:33:38.397927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:33:38.399462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:33:38.409867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1230/2470] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:33:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:33:42.878949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:33:42.880297 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:33:42.912029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947a15a-1534-4746-a761-2f0de991ac1c service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:33:42.917605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:33:42.918284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:33:42.918571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:33:42.918847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:33:42.920625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:33:42.979178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:33:42.980805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:33:42.990280 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1241/2471] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:33:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:33:48.404730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=28 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:33:52.986025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=80 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:34:06.392529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:34:06.401276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c9eeb-8f86-4ffc-860c-e37f29a24fac service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:34:06.404946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:34:06.405588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:34:06.405872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:34:06.406149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:34:06.407991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:34:06.488174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:34:06.489626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:34:06.507861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1231/2472] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:34:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:34:16.505221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=41 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:34:39.440950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:34:39.442487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:34:39.518997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d79a1-a43d-44ad-a98e-841e8c83b370 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:34:39.522633 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:34:39.523279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:34:39.523563 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:34:39.523841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:34:39.525605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:34:39.534895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:34:39.536302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:34:39.544160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1242/2473] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:34:45.696259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:34:45.704747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0a04-d707-4c35-80f0-be73892310b8 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:34:45.708292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:34:45.708923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:34:45.709201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:34:45.709476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:34:45.711252 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] Could not find project: 54bb3bfb06d24604ba2876cd13c74add.: keystone.exception.ProjectNotFound: Could not find project: 54bb3bfb06d24604ba2876cd13c74add. Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 21 10:34:45.724138 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:34:45.725573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:34:45.727086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:34:45.728258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:34:45.729440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 54bb3bfb06d24604ba2876cd13c74add. Jul 21 10:34:45.729440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 21 10:34:45.729440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1232/2474] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:34:45 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 21 10:34:47.658775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:34:47.660347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:34:47.671284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7869b3-547c-4834-b502-84fcd25f0cdc service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:34:47.676043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:34:47.676888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:34:47.677310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:34:47.677658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:34:47.680066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:34:47.716654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:34:47.718107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:34:47.733221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1243/2475] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:34:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:34:48.854809 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:34:48.866961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da441-90e7-4c7b-af53-baf46c061f53 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:34:48.870694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:34:48.871409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:34:48.872343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:34:48.872638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:34:48.874528 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:34:48.890843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:34:48.892441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:34:48.904068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1233/2476] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:34:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:34:57.726251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=46 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:34:58.899129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:36:46.917248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:46.927461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f4427-37de-4a55-a461-019e03e20d70 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:46.931269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:46.931920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:46.932205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:46.932480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:46.940794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:46.942240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:46.951152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1244/2477] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:36:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:36:47.201542 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:47.211488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed6dde-eab3-456d-9b0c-32a607f3cf63 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:47.215269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:47.216213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:47.216213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:47.216478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:47.218295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:36:47.305360 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:47.306983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:47.328052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1234/2478] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:36:47.486912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:47.500490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f5f87-fc50-4184-a9cc-adfaece28272 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:47.504265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:47.505322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:47.505832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:47.506212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:47.508885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:36:47.601739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:47.603205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:47.621863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1245/2479] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:36:50.492950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:50.510947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b213b-af3b-45db-b454-b0f36ead3d27 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:50.516250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:50.517155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:50.517624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:50.518075 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:50.520498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:36:50.545205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:50.548017 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:50.574019 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1235/2480] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:36:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:36:53.773420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:53.774985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:36:53.791473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06a5e-4eef-46ed-a2df-aa671f80a613 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:53.792326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:53.793019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:53.793302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:53.793581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] PATH_INFO: `/v3/users/560abc0036ba4a9eb7e53ecc0930afe1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:53.794829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=560abc0036ba4a9eb7e53ecc0930afe1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:53.796736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:53.846937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560abc0036ba4a9eb7e53ecc0930afe1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:53.859617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560abc0036ba4a9eb7e53ecc0930afe1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:53.866321 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560abc0036ba4a9eb7e53ecc0930afe1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:53.873485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560abc0036ba4a9eb7e53ecc0930afe1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:53.874076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560abc0036ba4a9eb7e53ecc0930afe1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:53.880523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1246/2481] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:36:53 2022] DELETE /identity/v3/users/560abc0036ba4a9eb7e53ecc0930afe1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:36:54.057682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:54.069624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf59dc5-569e-45d1-8f24-6b2b5bff17d0 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:54.131682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:54.132573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:54.132857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:54.133131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] PATH_INFO: `/v3/projects/8f52b214b1024e3a8adf81d2efd68eef` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:54.134339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f52b214b1024e3a8adf81d2efd68eef)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:54.136232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:54.181987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f52b214b1024e3a8adf81d2efd68eef', 'request_id': 'req-d6ab6370-eb83-4878-afb0-60289120d4ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.188942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f52b214b1024e3a8adf81d2efd68eef', 'request_id': 'req-d6ab6370-eb83-4878-afb0-60289120d4ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.190971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:36:54.196190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f52b214b1024e3a8adf81d2efd68eef', 'request_id': 'req-d6ab6370-eb83-4878-afb0-60289120d4ab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.209325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] The token cache is being invalidate because project 8f52b214b1024e3a8adf81d2efd68eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:36:54.209610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.210311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.211844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1236/2482] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:36:54 2022] DELETE /identity/v3/projects/8f52b214b1024e3a8adf81d2efd68eef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:36:54.215909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:54.217388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:36:54.231565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9891930-2314-4058-9f68-591b7270bc0c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:54.250835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:36:54.288583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:54.289454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:54.289738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:54.290012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] PATH_INFO: `/v3/users/1cd6a8b86d834df6992a1916ed7e07ad` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:54.305143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd6a8b86d834df6992a1916ed7e07ad)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:54.307104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:54.355053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd6a8b86d834df6992a1916ed7e07ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.367262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd6a8b86d834df6992a1916ed7e07ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.374154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd6a8b86d834df6992a1916ed7e07ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.382078 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd6a8b86d834df6992a1916ed7e07ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.382724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd6a8b86d834df6992a1916ed7e07ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.389051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1247/2483] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:36:54 2022] DELETE /identity/v3/users/1cd6a8b86d834df6992a1916ed7e07ad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:36:54.625481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:36:54.627036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:36:54.640291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab6370-eb83-4878-afb0-60289120d4ab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:36:54.697976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:36:54.698795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:36:54.699077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:36:54.699347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] PATH_INFO: `/v3/projects/b8c36a28c03142ba9bbc69cae73bfd53` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:36:54.709883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c36a28c03142ba9bbc69cae73bfd53)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:36:54.711962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:36:54.774679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c36a28c03142ba9bbc69cae73bfd53', 'request_id': 'req-36c7c93e-d9dc-4032-90dd-0a9ba9921534'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.783444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c36a28c03142ba9bbc69cae73bfd53', 'request_id': 'req-36c7c93e-d9dc-4032-90dd-0a9ba9921534'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.789193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c36a28c03142ba9bbc69cae73bfd53', 'request_id': 'req-36c7c93e-d9dc-4032-90dd-0a9ba9921534'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.801080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] The token cache is being invalidate because project b8c36a28c03142ba9bbc69cae73bfd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:36:54.801364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.801988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-36c7c93e-d9dc-4032-90dd-0a9ba9921534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:36:54.803559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1237/2484] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:36:54 2022] DELETE /identity/v3/projects/b8c36a28c03142ba9bbc69cae73bfd53 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:37:04.385347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=47,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:04.797589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=60,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:44.386135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:44.387647 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:44.456094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02223f9-e939-4996-a09d-6d6905cdb4cf admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:44.515362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:44.516022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:44.516332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:44.516616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:44.518568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:44.530129 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:44.531729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:44.542632 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1248/2485] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:54.537927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=58 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:41.132405 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:41.132882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:41.133059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:41.168512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] MFA Rules not processed for user `b3e73f3002da4da3b94cb17f837defb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:41.169717 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:41.232724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1238/2486] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:41.547197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:41.548583 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:41.607403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daec71-2ac7-444a-a58e-d102f12c2720 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:41.615025 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:41.615744 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:41.616098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:41.616461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:41.618373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:41.629342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:41.630937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:41.638880 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1249/2487] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:41.962353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:41.963787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:41.978615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69b84-6ac5-490b-9932-e6b63d469345 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:41.983558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:41.984212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:41.984495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:41.984769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:41.987107 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:41.999898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:42.001505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:42.012627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1239/2488] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:42.951261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:42.952791 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:42.964596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798245cf-7b75-493d-b3db-9936b85f05a8 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:42.968342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:42.968998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:42.969286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:42.969566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:42.971376 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:42.984865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:42.986390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:42.997083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1250/2489] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:44.455740 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:44.457196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:44.551259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7506586-6387-49dd-9ad2-c0567c269584 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:44.557029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:44.557775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:44.558129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:44.558495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:44.560407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:44.573454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:44.575084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:44.590544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1240/2490] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:47.598570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:47.599995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:47.670722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb8610-e3ad-4cf7-a694-0babeee69dfd service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:47.674361 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:47.675015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:47.675946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:47.676227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:47.677985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:47.768698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:47.770197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:47.789999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1251/2491] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:47.836779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:47.846046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030fe51-ed87-438c-af75-89289edc28de service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:47.850391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:47.851038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:47.851589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:47.851871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:47.853726 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:47.907710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:47.937727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:47.939223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:47.959984 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1241/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:52.636375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:52.638016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:52.650895 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:52.657924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10fde1-9662-40e0-a44e-e9822ce1fb48 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:52.664704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:52.665508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:52.665891 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:52.666326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:52.668315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:52.681684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:52.683640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:52.696640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1252/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:53.160466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:53.169667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5cc17-94c7-4ac8-a8f6-6a3c86a2edbe service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:53.173263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:53.173902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:53.174200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:53.174487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:53.176748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:53.239433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:53.240803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:53.250448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1242/2494] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:57.181196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:57.183083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:57.217029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f4d92-4ca8-4443-bd55-e0380626f3ee service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:57.222955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:57.224358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:57.224358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:57.224572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] PATH_INFO: `/v3/users/b0ff075d9612455a93a898413e8a948e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:57.226031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ff075d9612455a93a898413e8a948e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:57.228366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:57.307147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ff075d9612455a93a898413e8a948e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.322745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ff075d9612455a93a898413e8a948e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.331749 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ff075d9612455a93a898413e8a948e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.342155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ff075d9612455a93a898413e8a948e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.343317 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a903305-953b-4209-9083-b713b6e93006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ff075d9612455a93a898413e8a948e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.354326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1253/2495] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:38:57 2022] DELETE /identity/v3/users/b0ff075d9612455a93a898413e8a948e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:38:57.562958 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:57.589663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d36a-91c2-45ef-bcd8-efb4abe736f1 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:57.654103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:57.654902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:57.655182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:57.655455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] PATH_INFO: `/v3/projects/8804e6669b274c118f26e0984e409917` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:57.656641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8804e6669b274c118f26e0984e409917)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:57.658785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:57.706642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8804e6669b274c118f26e0984e409917', 'request_id': 'req-369ef6d3-f5b8-4799-acba-fe1bd310a74e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.714040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8804e6669b274c118f26e0984e409917', 'request_id': 'req-369ef6d3-f5b8-4799-acba-fe1bd310a74e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.716112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:57.721429 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8804e6669b274c118f26e0984e409917', 'request_id': 'req-369ef6d3-f5b8-4799-acba-fe1bd310a74e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.734731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] The token cache is being invalidate because project 8804e6669b274c118f26e0984e409917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:38:57.735022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.735692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-369ef6d3-f5b8-4799-acba-fe1bd310a74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:38:57.737828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1243/2496] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:38:57 2022] DELETE /identity/v3/projects/8804e6669b274c118f26e0984e409917 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:38:57.743759 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dea9b-7019-44b6-839d-0f0d541fdfe9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:57.744048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dea9b-7019-44b6-839d-0f0d541fdfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:57.744326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dea9b-7019-44b6-839d-0f0d541fdfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:57.805764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8f8dea9b-7019-44b6-839d-0f0d541fdfe9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:57.807029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f8dea9b-7019-44b6-839d-0f0d541fdfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:57.868611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1254/2497] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:57.876641 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ddab-b3bb-4345-b343-617b6956cb58 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:57.876932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ddab-b3bb-4345-b343-617b6956cb58 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:57.877216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ddab-b3bb-4345-b343-617b6956cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:57.895887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fa65ddab-b3bb-4345-b343-617b6956cb58 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:57.897123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fa65ddab-b3bb-4345-b343-617b6956cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:57.905660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1244/2498] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:57.910323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dea9b-7019-44b6-839d-0f0d541fdfe9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:57.920249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dea9b-7019-44b6-839d-0f0d541fdfe9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:57.925445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:57.926112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:57.926438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:57.926714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:57.927447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:38:57.927755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:57.929357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:57.941606 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1255/2499] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:38:57.945935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ddab-b3bb-4345-b343-617b6956cb58 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:57.955602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ddab-b3bb-4345-b343-617b6956cb58 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:57.960607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:57.961316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:57.961600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:57.961874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:57.962616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:57.964569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:58.001937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1245/2500] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:38:57 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:38:58.006349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:58.016359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0dd9a-ee91-41de-846b-2d9b905fb91f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:58.033272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:58.074660 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:58.075331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.075624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.075910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.076612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:58.078549 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:58.098506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1256/2501] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:38:58 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:38:58.102818 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:58.113756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1dd3f-1ad9-4c25-9a5c-2253d7c493a7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:58.118925 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:58.119594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.119880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.120155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.120899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:58.122628 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:58.132591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1246/2502] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:38:58.136409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:58.146355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e2f9f-0321-49f3-b319-83286a1d36a7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:58.150989 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842baff-7e3c-4a39-b2de-5744550c46c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:58.151643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842baff-7e3c-4a39-b2de-5744550c46c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.151931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842baff-7e3c-4a39-b2de-5744550c46c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.152215 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842baff-7e3c-4a39-b2de-5744550c46c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.152947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842baff-7e3c-4a39-b2de-5744550c46c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:58.154770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842baff-7e3c-4a39-b2de-5744550c46c3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:58.165364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1257/2503] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:38:58.169234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:58.180438 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f29e8-3fdd-4ace-8fa2-294128cc298c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:58.185771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:58.186845 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.187174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.187496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] PATH_INFO: `/v3/projects/c0afd159d9934a588ddda1a864cc9973/users/bdb0530980a146d19e0b2f68bdc0fa53/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.202313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0afd159d9934a588ddda1a864cc9973, user_id=bdb0530980a146d19e0b2f68bdc0fa53, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:58.204934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:58.218368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1247/2504] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:38:58 2022] PUT /identity/v3/projects/c0afd159d9934a588ddda1a864cc9973/users/bdb0530980a146d19e0b2f68bdc0fa53/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:38:58.224036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59761-0e68-4cbe-91ac-55f04cffb27f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.224603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59761-0e68-4cbe-91ac-55f04cffb27f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.224603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59761-0e68-4cbe-91ac-55f04cffb27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.243049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-56a59761-0e68-4cbe-91ac-55f04cffb27f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:58.244265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-56a59761-0e68-4cbe-91ac-55f04cffb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:58.306510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1258/2505] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:58.316345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:58.318179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:58.374299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475efc82-f167-492e-963c-a131e43d35cd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:58.377967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:58.378745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.379021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.379296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.388097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:58.389512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:58.399520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1248/2506] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:02.377424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6abed-ec63-4e85-be18-e1275c5b1599 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:02.377946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6abed-ec63-4e85-be18-e1275c5b1599 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:02.378064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6abed-ec63-4e85-be18-e1275c5b1599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:02.406419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0be6abed-ec63-4e85-be18-e1275c5b1599 None None] MFA Rules not processed for user `bdb0530980a146d19e0b2f68bdc0fa53`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:02.407705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0be6abed-ec63-4e85-be18-e1275c5b1599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:02.485718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1259/2507] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:02.500471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:02.502099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:02.596800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76c6d7-c856-4c9a-b29b-a58878dfffe6 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:02.603463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:02.604148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:02.604431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:02.604708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:02.618747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:02.620369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:02.631864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1249/2508] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:03.957821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97037-5876-467a-ab92-ccecd97afb63 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:03.958427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97037-5876-467a-ab92-ccecd97afb63 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:03.958427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97037-5876-467a-ab92-ccecd97afb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:03.977083 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-05a97037-5876-467a-ab92-ccecd97afb63 None None] MFA Rules not processed for user `bdb0530980a146d19e0b2f68bdc0fa53`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:03.978330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-05a97037-5876-467a-ab92-ccecd97afb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:03.985262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1260/2509] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:12.626596 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:13.970513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:18.778577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:18.780042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:18.794802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4ffc1-226c-4f35-aa8f-0c074ba1800e service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:18.800612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:18.801338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:18.801693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:18.802588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:18.804443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:18.816666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:18.818848 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:18.829298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1250/2510] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:28.824808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:45.433436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97037-5876-467a-ab92-ccecd97afb63 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:45.443683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97037-5876-467a-ab92-ccecd97afb63 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:45.447414 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:45.448067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:45.448351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:45.448628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:45.450542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:45.460642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:45.462115 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:45.470942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1261/2511] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:55.466972 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:48.543643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:48.545087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:48.609136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351cb3c-cedb-4c51-83b7-cf4f80d33a74 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:48.612916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:48.613580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:48.613891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:48.614135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:48.616127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:48.703873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:48.705547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:48.718900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01770-40f9-4c90-b8a2-ae616bfa8155 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:48.722835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ccd91-ed9a-4421-b4dc-71f243e94516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:48.723675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ccd91-ed9a-4421-b4dc-71f243e94516 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:48.724126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ccd91-ed9a-4421-b4dc-71f243e94516 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:48.724679 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ccd91-ed9a-4421-b4dc-71f243e94516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:48.727100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-435ccd91-ed9a-4421-b4dc-71f243e94516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:48.739583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:48.741094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:48.763469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1251/2512] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:42:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:42:48.798151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ccd91-ed9a-4421-b4dc-71f243e94516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:48.799619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ccd91-ed9a-4421-b4dc-71f243e94516 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:48.810088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1262/2513] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:42:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:42:48.958022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:48.959557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:49.000144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50f0f6-6009-44c5-84d5-076c2aa82fb0 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:49.005236 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:49.006433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:49.006850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:49.007183 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] PATH_INFO: `/v3/users/1670f9cffa264167bed8dd590d5d9db7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:49.008459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1670f9cffa264167bed8dd590d5d9db7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:49.010956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:49.059834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1670f9cffa264167bed8dd590d5d9db7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.060498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1670f9cffa264167bed8dd590d5d9db7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.067455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1670f9cffa264167bed8dd590d5d9db7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.068086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1670f9cffa264167bed8dd590d5d9db7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.072399 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:49.078070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1670f9cffa264167bed8dd590d5d9db7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.099772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1252/2514] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:42:48 2022] DELETE /identity/v3/users/1670f9cffa264167bed8dd590d5d9db7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:42:49.104761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:49.105053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:49.105341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:49.121944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:42:49.123178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:49.181874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1263/2515] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:42:49.192121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:49.193510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:49.250835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4c93-396f-4852-8b08-4e8fdf354e95 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:49.254358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:49.254996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:49.255280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:49.255552 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:49.264931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:49.266387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:49.277301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1253/2516] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:42:49.550794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:49.552427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:49.565012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554095-1e29-4aa3-8be1-89595a82ac59 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:49.569689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:49.570592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:49.570876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:49.571152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] PATH_INFO: `/v3/projects/82a87837cf7b437aa71a12ea126d623e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:49.573135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a87837cf7b437aa71a12ea126d623e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:49.575075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:49.622822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a87837cf7b437aa71a12ea126d623e', 'request_id': 'req-1dd08961-9b59-4fae-ac83-e56856af8580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.628856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a87837cf7b437aa71a12ea126d623e', 'request_id': 'req-1dd08961-9b59-4fae-ac83-e56856af8580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.634898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a87837cf7b437aa71a12ea126d623e', 'request_id': 'req-1dd08961-9b59-4fae-ac83-e56856af8580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.647221 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] The token cache is being invalidate because project 82a87837cf7b437aa71a12ea126d623e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:42:49.647515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.648128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:49.649757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1264/2517] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:42:49 2022] DELETE /identity/v3/projects/82a87837cf7b437aa71a12ea126d623e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:42:49.734119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:49.736239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:49.837784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ffd2d-a4ad-4323-89b2-d209876ffb84 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:49.898784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:49.899480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:49.899771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:49.900048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:49.901858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:49.909515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:49.914549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:49.916805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:49.926960 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1254/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:42:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:42:59.644256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:59.922763 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:48.992661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:48.994048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:49.011005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:49.012967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:49.114031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08961-9b59-4fae-ac83-e56856af8580 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:49.114886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c6835-6bbe-4eea-a01a-019ccc9cad00 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:49.117728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:49.118389 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:49.118671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:49.118781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:49.118942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:49.119395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:49.119678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:49.119953 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:49.120787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:49.121701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:49.182298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:49.183747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:49.192725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1255/2519] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:44:49.194990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:49.196448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:49.209012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1265/2520] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:49.275070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:49.287027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf5b1-b7ec-4efe-a462-72bfb301be95 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:49.292906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:49.294682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:49.295124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:49.295600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:49.299227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:49.375383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:49.376854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:49.390512 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1256/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:50.680194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:50.682691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:50.780722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:50.817501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83493f2d-f5d8-434e-a7a7-710b0802e517 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:50.824139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:50.824919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:50.825303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:50.825587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:50.827631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:50.840817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:50.842473 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:50.854526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1266/2522] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:59.382475 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:45:00.848990 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=16 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:45:52.391202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:45:52.392761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:45:52.476021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52143a-e4df-46e1-8dec-2cd27c9bad66 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:45:52.479722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:45:52.480368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:45:52.480650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:45:52.480919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:45:52.482737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:45:52.494073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:45:52.495564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:45:52.505047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1257/2523] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:02.500260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=35 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:48.169684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:48.180419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f58ed0-5427-434b-b250-50dd24d58dd9 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:48.184075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:48.184721 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:48.185006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:48.185304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:48.187144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:48.290326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:48.293027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:48.312645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1267/2524] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:51.786922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:51.788445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:51.805103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166892c-769e-4185-8c97-14d4dbf4b70b service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:51.810278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:51.811033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.812224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.812511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.815321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:51.828413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:51.830897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:51.847660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1258/2525] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:51.858191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:51.859937 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:51.874914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546582e-e25a-45f8-a9a6-138a569ab136 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:51.881443 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:51.882422 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.883126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.883428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] PATH_INFO: `/v3/users/cb3146ed5b1947ee99cba2e95a777a6f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.884698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3146ed5b1947ee99cba2e95a777a6f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:51.886669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:51.934629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3146ed5b1947ee99cba2e95a777a6f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.948497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3146ed5b1947ee99cba2e95a777a6f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.955673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3146ed5b1947ee99cba2e95a777a6f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.963547 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3146ed5b1947ee99cba2e95a777a6f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.964261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a1cefd99-a2d9-4278-b0f2-8fc51edfb849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3146ed5b1947ee99cba2e95a777a6f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.971005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1268/2526] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:51 2022] DELETE /identity/v3/users/cb3146ed5b1947ee99cba2e95a777a6f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:52.155775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.168301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550a7d-71c1-4fd6-9ddb-2b941e79642f service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.229462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.230390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.230673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.230950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] PATH_INFO: `/v3/projects/0b5845b217704fe4866953d3d169c1be` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.232173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5845b217704fe4866953d3d169c1be)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.234108 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.284417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5845b217704fe4866953d3d169c1be', 'request_id': 'req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.292843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5845b217704fe4866953d3d169c1be', 'request_id': 'req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.299679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5845b217704fe4866953d3d169c1be', 'request_id': 'req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.311057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] The token cache is being invalidate because project 0b5845b217704fe4866953d3d169c1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:52.311343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.312004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1dc091f7-5c1a-4575-9b55-4d07b8dd0e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.313594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1259/2527] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:52 2022] DELETE /identity/v3/projects/0b5845b217704fe4866953d3d169c1be => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:52.325085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f472388-b760-408d-9b80-932a46e21fdd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.325299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f472388-b760-408d-9b80-932a46e21fdd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.325711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f472388-b760-408d-9b80-932a46e21fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.346872 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7f472388-b760-408d-9b80-932a46e21fdd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:52.348147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f472388-b760-408d-9b80-932a46e21fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.382403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:52.416150 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1269/2528] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:52.424200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e99ec-e257-41a0-81ff-ebdd9346dcde None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.424500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e99ec-e257-41a0-81ff-ebdd9346dcde None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.424766 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e99ec-e257-41a0-81ff-ebdd9346dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.443540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a38e99ec-e257-41a0-81ff-ebdd9346dcde None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:52.444802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a38e99ec-e257-41a0-81ff-ebdd9346dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.454002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1260/2529] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:52.460582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f472388-b760-408d-9b80-932a46e21fdd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.471415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f472388-b760-408d-9b80-932a46e21fdd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.477771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.478619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.478800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.479063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.479771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:52.480084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.481889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.497716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1270/2530] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:52.502982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e99ec-e257-41a0-81ff-ebdd9346dcde None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.512832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e99ec-e257-41a0-81ff-ebdd9346dcde None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.524175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.525400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.525694 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.525997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.526755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.528878 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.561366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1261/2531] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:52 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:46:52.565360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.584421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cfe1-ef10-4cb0-9c5d-77eed3167c17 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.645936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.647479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.647873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.648207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.648951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.650946 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.675709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1271/2532] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:52 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:52.679876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.693928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4288a-41af-4163-8757-b2111e7b8fa1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.698924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.700233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.700524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.700963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.702333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.705056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.717190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1262/2533] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:46:52.721618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.732151 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b79ff-5841-4d45-a7f8-f57240286c72 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.736960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01d790-49f7-4303-aea5-d29834ce544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.737730 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d790-49f7-4303-aea5-d29834ce544b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.738020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d790-49f7-4303-aea5-d29834ce544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.738348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d790-49f7-4303-aea5-d29834ce544b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.739101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01d790-49f7-4303-aea5-d29834ce544b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.740944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01d790-49f7-4303-aea5-d29834ce544b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.753272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1272/2534] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:46:52.758672 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.772650 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8cd6e-2107-41d9-8b09-5af00f11e01e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.778128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.778974 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.780302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.780302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] PATH_INFO: `/v3/projects/8fa533f39703493fa9c9cb77679cc0fc/users/c80cfa7bf8554ee6969d012a7d75fdb0/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.800860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa533f39703493fa9c9cb77679cc0fc, user_id=c80cfa7bf8554ee6969d012a7d75fdb0, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.803955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.820548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1263/2535] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:52 2022] PUT /identity/v3/projects/8fa533f39703493fa9c9cb77679cc0fc/users/c80cfa7bf8554ee6969d012a7d75fdb0/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:52.833853 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0744b60-95cb-4e3d-9db1-9f8b435d3949 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.834139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0744b60-95cb-4e3d-9db1-9f8b435d3949 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.834683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0744b60-95cb-4e3d-9db1-9f8b435d3949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.867543 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a0744b60-95cb-4e3d-9db1-9f8b435d3949 None None] MFA Rules not processed for user `c80cfa7bf8554ee6969d012a7d75fdb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:52.869704 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0744b60-95cb-4e3d-9db1-9f8b435d3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.958703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1273/2536] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:52.987917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.991843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:53.014211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:53.072335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a6298-ac8c-42de-93a0-f68e94f688c2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:53.076159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:53.076837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:53.077124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:53.077402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:53.088409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:53.089783 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:53.101018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1264/2537] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:02.955485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:03.096321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=20 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:49.067595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0744b60-95cb-4e3d-9db1-9f8b435d3949 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:49.083430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0744b60-95cb-4e3d-9db1-9f8b435d3949 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:49.087171 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:49.088175 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:49.088735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:49.089133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:49.091446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:49.204022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:49.206825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:49.232339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1274/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:58.706134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:58.708428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:58.801158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b67fb-e405-47ee-80bf-8fdd0712c786 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:58.808048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:58.808836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:58.809215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:58.809574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:58.812583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:58.829836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:58.831535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:58.843997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1265/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:59.229331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=41 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:08.838078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=32 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:56.838477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:56.839942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:56.866883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb047b58-73d7-4ddf-b706-c638ed820f1e service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:56.870778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:56.871984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:56.872305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:56.872595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:56.874582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:56.949813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:56.951411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:56.963393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1275/2540] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:57.221822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:57.232704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8e116-71f4-4b62-952f-95bd378f21f3 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:57.236619 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:57.237260 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:57.237545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:57.237545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:57.240008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:57.259222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:57.261911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:57.278703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1266/2541] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:59.110699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:59.125827 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:59.235842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cad00f-4805-499f-9008-b64649346f1d service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:59.240506 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808680be-7813-4352-83d7-df3db7cbe1ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164a361891274af1b20fe7b7458ecde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:59.241173 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808680be-7813-4352-83d7-df3db7cbe1ef service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:59.241611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808680be-7813-4352-83d7-df3db7cbe1ef service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:59.241896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808680be-7813-4352-83d7-df3db7cbe1ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:59.243790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-808680be-7813-4352-83d7-df3db7cbe1ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-808680be-7813-4352-83d7-df3db7cbe1ef service glance] Could not find project: 8f52b214b1024e3a8adf81d2efd68eef.: keystone.exception.ProjectNotFound: Could not find project: 8f52b214b1024e3a8adf81d2efd68eef. Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 21 10:48:59.262200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:48:59.264208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:48:59.267386 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:48:59.269533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:48:59.271949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8f52b214b1024e3a8adf81d2efd68eef. Jul 21 10:48:59.271949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 21 10:48:59.271949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1276/2542] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:59 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 21 10:49:07.272467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:09.248898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=72 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:11.348712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:11.453654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a4a7e-75cd-4fca-aeff-d21614350eab service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:11.466281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:11.467947 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:11.468743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:11.469142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] PATH_INFO: `/v3/users/c80cfa7bf8554ee6969d012a7d75fdb0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:11.473317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80cfa7bf8554ee6969d012a7d75fdb0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:11.479152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:11.574579 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80cfa7bf8554ee6969d012a7d75fdb0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:11.578860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80cfa7bf8554ee6969d012a7d75fdb0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:11.596730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80cfa7bf8554ee6969d012a7d75fdb0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:11.598244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80cfa7bf8554ee6969d012a7d75fdb0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:11.615380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80cfa7bf8554ee6969d012a7d75fdb0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:11.649103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1267/2543] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:49:11 2022] DELETE /identity/v3/users/c80cfa7bf8554ee6969d012a7d75fdb0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:11.657248 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:11.658323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:11.658882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:11.707146 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:11.708669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:11.799720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1277/2544] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:11.810505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:11.812059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:11.892946 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6a71a-ccd1-4f62-82de-db1bdfb5e58a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:11.898120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0ab2-161d-4c46-9c34-829d81451bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:11.899062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0ab2-161d-4c46-9c34-829d81451bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:11.899493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0ab2-161d-4c46-9c34-829d81451bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:11.900106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0ab2-161d-4c46-9c34-829d81451bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:11.914368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0ab2-161d-4c46-9c34-829d81451bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:11.917257 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0ab2-161d-4c46-9c34-829d81451bc5 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:11.935168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1268/2545] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:12.341256 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:12.343613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:12.364124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518570c-26ac-4ff4-8bb8-a6f502d79ace None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:12.375552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:12.379845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:12.380519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:12.381085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] PATH_INFO: `/v3/projects/8fa533f39703493fa9c9cb77679cc0fc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:12.383382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa533f39703493fa9c9cb77679cc0fc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:12.388183 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:12.460472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa533f39703493fa9c9cb77679cc0fc', 'request_id': 'req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:12.467701 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa533f39703493fa9c9cb77679cc0fc', 'request_id': 'req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:12.477883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa533f39703493fa9c9cb77679cc0fc', 'request_id': 'req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:12.503197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] The token cache is being invalidate because project 8fa533f39703493fa9c9cb77679cc0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:49:12.503533 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:12.504259 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7ea93cb-0b2e-40ed-90ce-e5af2b000778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:12.505876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1278/2546] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:49:12 2022] DELETE /identity/v3/projects/8fa533f39703493fa9c9cb77679cc0fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:12.511371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09800bcd-c01e-48ac-bad2-32154f3e6673 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:12.512189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09800bcd-c01e-48ac-bad2-32154f3e6673 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:12.512189 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09800bcd-c01e-48ac-bad2-32154f3e6673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:12.552749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:12.589990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-09800bcd-c01e-48ac-bad2-32154f3e6673 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:12.591259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-09800bcd-c01e-48ac-bad2-32154f3e6673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:12.722343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1269/2547] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:12.726228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abfac0-32a3-469b-b789-1fc1eb6c1b0f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:12.726973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abfac0-32a3-469b-b789-1fc1eb6c1b0f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:12.727439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abfac0-32a3-469b-b789-1fc1eb6c1b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:12.762044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-78abfac0-32a3-469b-b789-1fc1eb6c1b0f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:12.764254 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-78abfac0-32a3-469b-b789-1fc1eb6c1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:12.777811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1279/2548] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:12.782539 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09800bcd-c01e-48ac-bad2-32154f3e6673 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:12.797171 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09800bcd-c01e-48ac-bad2-32154f3e6673 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:12.802524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:12.803235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:12.803529 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:12.803807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:12.804635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:49:12.805673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:12.806531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:12.820483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1270/2549] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:49:12.825953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abfac0-32a3-469b-b789-1fc1eb6c1b0f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:12.840342 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abfac0-32a3-469b-b789-1fc1eb6c1b0f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:12.847030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:12.847991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:12.848483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:12.848825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:12.849953 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:12.853136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:12.900209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1280/2550] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:49:12 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:49:12.905201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:12.917332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3ceb-0442-4ced-9233-bed535f906a0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:12.996566 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:12.997779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:12.998101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:12.998442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:12.999234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.001231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.025757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1271/2551] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:49:12 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:49:13.031289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.044668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4e7f0-3a6d-470a-89f6-898c638cdf96 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.050392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.051103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.051391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.051675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.052428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.054095 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.066879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1281/2552] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:49:13.073828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.090909 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeafa8f-07e1-40b0-9cdd-e08977d04347 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.095821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59595c-0563-4194-a53e-c5783cf7b01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.096535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59595c-0563-4194-a53e-c5783cf7b01f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.096821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59595c-0563-4194-a53e-c5783cf7b01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.097091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59595c-0563-4194-a53e-c5783cf7b01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.097842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59595c-0563-4194-a53e-c5783cf7b01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.099541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59595c-0563-4194-a53e-c5783cf7b01f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.118128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1272/2553] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:49:13.123598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.140784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd164-66d4-4632-87ba-d25514e88059 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.148077 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.149573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.150072 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.150605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] PATH_INFO: `/v3/projects/2e9ac2045f2a420eb8ca385d43f573b8/users/4007e8cd329d49ada12a7ef8623883c9/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.175695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9ac2045f2a420eb8ca385d43f573b8, user_id=4007e8cd329d49ada12a7ef8623883c9, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.180155 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.200403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1282/2554] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:49:13 2022] PUT /identity/v3/projects/2e9ac2045f2a420eb8ca385d43f573b8/users/4007e8cd329d49ada12a7ef8623883c9/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:13.211460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a5804-dcb6-4606-8bd8-73c487b6641b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.211889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a5804-dcb6-4606-8bd8-73c487b6641b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.212339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a5804-dcb6-4606-8bd8-73c487b6641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.245496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a11a5804-dcb6-4606-8bd8-73c487b6641b None None] MFA Rules not processed for user `4007e8cd329d49ada12a7ef8623883c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:13.247549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a11a5804-dcb6-4606-8bd8-73c487b6641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:13.314681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:13.328368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1273/2555] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:49:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:13.333253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.339213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:13.404933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06525df7-cf6b-4be4-95b8-f67b140926c1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.409981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.410696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.410982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.411262 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.411983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.413930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.454064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1283/2556] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:49:13 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:49:13.458762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a5804-dcb6-4606-8bd8-73c487b6641b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.471082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a5804-dcb6-4606-8bd8-73c487b6641b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.537538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.538474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.538873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.539359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.540598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.544577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.571786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1274/2557] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:49:13 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:49:13.577576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.592535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05b53-3a5d-4774-b2d7-c8b3225860c4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.597725 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.598454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.598742 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.599029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.599778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.601728 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.621787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1284/2558] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:49:13.627654 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.639332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf876-3c7e-4544-9c5b-da723012df30 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.644190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.645106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.645389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.645665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] PATH_INFO: `/v3/projects/1d043d665d044c42964dafb40055253f/users/3f7f9874ed3346e99a5f5d944bd131b4/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.663024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d043d665d044c42964dafb40055253f, user_id=3f7f9874ed3346e99a5f5d944bd131b4, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.665677 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.681825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1275/2559] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:49:13 2022] PUT /identity/v3/projects/1d043d665d044c42964dafb40055253f/users/3f7f9874ed3346e99a5f5d944bd131b4/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:13.687428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.698012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e6df-9f98-4d12-bc93-372278f49aed admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.773761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cdae2-fa20-424f-9481-cc85812feaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.774905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cdae2-fa20-424f-9481-cc85812feaba admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.774905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cdae2-fa20-424f-9481-cc85812feaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.775816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cdae2-fa20-424f-9481-cc85812feaba admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.775816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cdae2-fa20-424f-9481-cc85812feaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.777922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cdae2-fa20-424f-9481-cc85812feaba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.795515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1285/2560] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:49:13.800384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.816132 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fc3ba-7890-457b-bae1-42aa28300d8f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.824225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.825443 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.825908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.826413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] PATH_INFO: `/v3/projects/1d043d665d044c42964dafb40055253f/users/3f7f9874ed3346e99a5f5d944bd131b4/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.829874 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d043d665d044c42964dafb40055253f, user_id=3f7f9874ed3346e99a5f5d944bd131b4, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:13.833729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:13.846062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1276/2561] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:49:13 2022] PUT /identity/v3/projects/1d043d665d044c42964dafb40055253f/users/3f7f9874ed3346e99a5f5d944bd131b4/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:49:13.858949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.859350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.859646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.885839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:13.887665 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:13.896267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] MFA Rules not processed for user `3f7f9874ed3346e99a5f5d944bd131b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:13.898468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:13.967938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd874e-f2db-483a-9700-51e4f8fbdee7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:13.971875 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:13.972536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:13.972943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:13.973163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:13.975156 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:14.006430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:14.014265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1286/2562] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:49:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:14.027646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:14.030199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:14.072063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:14.075923 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:14.077407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:14.092514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1277/2563] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:49:14.114542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87446-6800-42b5-9326-a6ea5a370ffb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:14.120843 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:14.121934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:14.122427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:14.122945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:14.139234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:14.140747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:14.155206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1287/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:49:14.253737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:14.264084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479ba27-79a1-4032-bd24-2ce43e9932c7 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:14.268046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:14.268861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:14.268997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:14.269284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:14.362956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:14.364890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:14.380198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1278/2565] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:14.766820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:14.769409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:14.797160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ce1eb-49f4-4892-8133-d3d771e27440 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:14.804992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:14.805890 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:14.806193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:14.806521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] PATH_INFO: `/v3/users/1184a6a19fa242ae973bf635b56b1f7c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:14.807856 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1184a6a19fa242ae973bf635b56b1f7c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:14.810411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:14.888611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1184a6a19fa242ae973bf635b56b1f7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:14.906324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1184a6a19fa242ae973bf635b56b1f7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:14.922322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1184a6a19fa242ae973bf635b56b1f7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:14.932284 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1184a6a19fa242ae973bf635b56b1f7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:14.933116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1184a6a19fa242ae973bf635b56b1f7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:14.941139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1288/2566] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:49:14 2022] DELETE /identity/v3/users/1184a6a19fa242ae973bf635b56b1f7c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:15.173899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:15.193320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf58186-51c4-4402-9b51-948c1d7465ad service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:15.268469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:15.270145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:15.270623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:15.271174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] PATH_INFO: `/v3/projects/134431b6758149c0a22426b97ba1b9da` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:15.273238 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=134431b6758149c0a22426b97ba1b9da)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:15.277518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:15.335142 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134431b6758149c0a22426b97ba1b9da', 'request_id': 'req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:15.344727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134431b6758149c0a22426b97ba1b9da', 'request_id': 'req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:15.352490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134431b6758149c0a22426b97ba1b9da', 'request_id': 'req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:15.369753 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] The token cache is being invalidate because project 134431b6758149c0a22426b97ba1b9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:49:15.370269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:15.371827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fd1dfbe8-9f6b-4891-ad11-ca8256ea6a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:15.374518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1279/2567] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:49:15 2022] DELETE /identity/v3/projects/134431b6758149c0a22426b97ba1b9da => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:24.936678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:25.364328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:26.382062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:26.383858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:26.591271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a7445-1785-477b-b234-023dbd7bd949 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:26.718808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:26.719483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:26.719766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:26.720053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:26.723043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:26.744922 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:26.752629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:26.771236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1289/2568] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:49:30.194795 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:30.195352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:30.195352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:30.241319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] MFA Rules not processed for user `b3e73f3002da4da3b94cb17f837defb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:30.243129 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:30.336207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1280/2569] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:49:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:30.755925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:30.758832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:30.835466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c546364-6f11-4fcf-accb-675160c458e1 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:30.839439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:30.842344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:30.842344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:30.842344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:30.842662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:30.865166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:30.865166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:30.871461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1290/2570] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:31.243394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:31.245180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:31.323218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e96691-9687-450d-9bdc-062e88e48361 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:31.328722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:31.329491 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:31.329793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:31.330097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:31.332907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:31.349889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:31.351719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:31.364192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1281/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:40.866988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:41.359536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=68 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:48.052410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:48.054684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:48.075726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f42131-7b1e-4ba1-9470-d2a6327aea18 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:48.082481 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:48.083303 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:48.083628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:48.083879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:48.085760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:48.103041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:48.105912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:48.118570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1291/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:49.599134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:49.619295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e59dd-f47e-4d7d-9ecf-2cd4c15a9511 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:49.626933 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2d495-f204-44da-bdc8-313b8550e0cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:49.627749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2d495-f204-44da-bdc8-313b8550e0cd service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:49.628071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2d495-f204-44da-bdc8-313b8550e0cd service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:49.628353 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2d495-f204-44da-bdc8-313b8550e0cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:49.630482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42c2d495-f204-44da-bdc8-313b8550e0cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:49.644011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2d495-f204-44da-bdc8-313b8550e0cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:49.646090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2d495-f204-44da-bdc8-313b8550e0cd service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:49.659067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1282/2573] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:58.114265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:59.652115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:03.739736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:03.741122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:03.836943 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ec677-429a-4548-b2dc-5c652c807169 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:03.844417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:03.845836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:03.846341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:03.846792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] PATH_INFO: `/v3/users/4007e8cd329d49ada12a7ef8623883c9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:03.848956 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4007e8cd329d49ada12a7ef8623883c9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:03.852882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:03.939005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4007e8cd329d49ada12a7ef8623883c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:03.961343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4007e8cd329d49ada12a7ef8623883c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:03.969620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4007e8cd329d49ada12a7ef8623883c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:03.980576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4007e8cd329d49ada12a7ef8623883c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:03.981627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4007e8cd329d49ada12a7ef8623883c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:03.991190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1292/2574] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:03 2022] DELETE /identity/v3/users/4007e8cd329d49ada12a7ef8623883c9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:03.997227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:03.997741 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:03.997951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:04.026735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:04.028863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:04.122652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1283/2575] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:04.132939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:04.134893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:04.217261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9d122-e5c6-40dc-9be5-1ba8f2f6fc3d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:04.221206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:04.221883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:04.222208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:04.222486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:04.233842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:04.235341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:04.247712 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1293/2576] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:04.666646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:04.668969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:04.692065 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082541a-9571-4acd-bba6-dc6fcbb6771a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:04.704610 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:04.705773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:04.706212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:04.706558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] PATH_INFO: `/v3/projects/2e9ac2045f2a420eb8ca385d43f573b8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:04.708214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9ac2045f2a420eb8ca385d43f573b8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:04.710842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:04.794476 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9ac2045f2a420eb8ca385d43f573b8', 'request_id': 'req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:04.803459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9ac2045f2a420eb8ca385d43f573b8', 'request_id': 'req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:04.812704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9ac2045f2a420eb8ca385d43f573b8', 'request_id': 'req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:04.833299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] The token cache is being invalidate because project 2e9ac2045f2a420eb8ca385d43f573b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:04.833803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:04.835067 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:04.838869 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1284/2577] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:04 2022] DELETE /identity/v3/projects/2e9ac2045f2a420eb8ca385d43f573b8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:04.842893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:04.856439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160bd90-6642-4dab-a185-05efae1bbd29 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:04.885277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:04.951333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:04.952847 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:04.953144 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:04.953433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] PATH_INFO: `/v3/users/3f7f9874ed3346e99a5f5d944bd131b4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:04.955526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7f9874ed3346e99a5f5d944bd131b4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:04.957566 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:05.026239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7f9874ed3346e99a5f5d944bd131b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.042900 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7f9874ed3346e99a5f5d944bd131b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.051122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7f9874ed3346e99a5f5d944bd131b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.060459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7f9874ed3346e99a5f5d944bd131b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.061323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-61bdeb45-3cd2-4602-af57-0a37589a0759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7f9874ed3346e99a5f5d944bd131b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.069829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1294/2578] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:04 2022] DELETE /identity/v3/users/3f7f9874ed3346e99a5f5d944bd131b4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:05.439794 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:05.441377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:05.456164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92751f-e6a0-4c84-8289-9f4d9a848e6c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:05.567632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:05.568514 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:05.568799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:05.569078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] PATH_INFO: `/v3/projects/1d043d665d044c42964dafb40055253f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:05.570358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d043d665d044c42964dafb40055253f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:05.573147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:05.625585 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:05.652508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d043d665d044c42964dafb40055253f', 'request_id': 'req-827d5842-07ef-4c82-b30c-e2c5046f0fa8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.671773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d043d665d044c42964dafb40055253f', 'request_id': 'req-827d5842-07ef-4c82-b30c-e2c5046f0fa8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.678376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d043d665d044c42964dafb40055253f', 'request_id': 'req-827d5842-07ef-4c82-b30c-e2c5046f0fa8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.689929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] The token cache is being invalidate because project 1d043d665d044c42964dafb40055253f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:05.690276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.691937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-827d5842-07ef-4c82-b30c-e2c5046f0fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:05.693043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1285/2579] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:05 2022] DELETE /identity/v3/projects/1d043d665d044c42964dafb40055253f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:05.700073 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccbfb4-ad26-4121-acd3-3b96152a30c9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:05.700464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccbfb4-ad26-4121-acd3-3b96152a30c9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:05.700790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccbfb4-ad26-4121-acd3-3b96152a30c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:05.724652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-60ccbfb4-ad26-4121-acd3-3b96152a30c9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:05.726161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-60ccbfb4-ad26-4121-acd3-3b96152a30c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:05.807696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1295/2580] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:05.816806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4dfc2-5f7e-4319-b12c-9fa013e30b40 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:05.817648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4dfc2-5f7e-4319-b12c-9fa013e30b40 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:05.817648 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4dfc2-5f7e-4319-b12c-9fa013e30b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:05.837852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7ba4dfc2-5f7e-4319-b12c-9fa013e30b40 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:05.839652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7ba4dfc2-5f7e-4319-b12c-9fa013e30b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:05.852481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1286/2581] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:05.860060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccbfb4-ad26-4121-acd3-3b96152a30c9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:05.882924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccbfb4-ad26-4121-acd3-3b96152a30c9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:05.889570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:05.890347 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:05.890671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:05.890988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:05.892043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:50:05.892493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:05.894552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:05.909720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1296/2582] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:50:05.914352 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4dfc2-5f7e-4319-b12c-9fa013e30b40 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:05.926011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4dfc2-5f7e-4319-b12c-9fa013e30b40 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:05.931205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:05.932174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:05.932466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:05.933036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:05.933841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:05.936040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:05.970242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1287/2583] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:05 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:50:05.975056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:05.987096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92cad-03b8-4ace-8181-7da445130609 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.025709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:06.070684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.071478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.071857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.072752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.073623 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.075819 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.098551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1297/2584] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:05 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:06.103039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.113661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bb36-be34-47d3-99e8-a3927d440997 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.119898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.119898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.120406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.120406 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.121081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.122808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.134371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1288/2585] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:06.139920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.151132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c85f2-2e35-43e5-a851-6e11b31f9788 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.157681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e0c2-61d7-4dc5-8a35-2e54578ec95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.158561 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e0c2-61d7-4dc5-8a35-2e54578ec95e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.158933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e0c2-61d7-4dc5-8a35-2e54578ec95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.159387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e0c2-61d7-4dc5-8a35-2e54578ec95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.160350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e0c2-61d7-4dc5-8a35-2e54578ec95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.162194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e0c2-61d7-4dc5-8a35-2e54578ec95e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.175030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1298/2586] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:50:06.179525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.194161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754257-3c71-4976-9c82-bb13aa303b17 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.201994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.203016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.203344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.203754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] PATH_INFO: `/v3/projects/0481b12a55a1444687239e97c420a56d/users/9c474a60c9454a44aa4ce05a7c6efe81/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.227618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0481b12a55a1444687239e97c420a56d, user_id=9c474a60c9454a44aa4ce05a7c6efe81, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.232168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.255750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1289/2587] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:06 2022] PUT /identity/v3/projects/0481b12a55a1444687239e97c420a56d/users/9c474a60c9454a44aa4ce05a7c6efe81/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:06.270775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9492b-d0af-4490-a1e7-dcf7f95aa89e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.271292 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9492b-d0af-4490-a1e7-dcf7f95aa89e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.271754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9492b-d0af-4490-a1e7-dcf7f95aa89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.300399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d8c9492b-d0af-4490-a1e7-dcf7f95aa89e None None] MFA Rules not processed for user `9c474a60c9454a44aa4ce05a7c6efe81`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:06.301664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d8c9492b-d0af-4490-a1e7-dcf7f95aa89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:06.389667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1299/2588] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:50:06.394122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.471054 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e30f4-523f-497d-943e-609f48de1f37 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.476485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.477184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.477469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.477748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.478976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.480955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.518944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1290/2589] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:06 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:06.523967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9492b-d0af-4490-a1e7-dcf7f95aa89e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.537081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9492b-d0af-4490-a1e7-dcf7f95aa89e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.610515 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.611277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.611607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.611947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.612719 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.615001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.638892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1300/2590] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:06 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:06.646133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.662686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0bd15-26f9-4444-a4ca-aaa00e087454 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.668099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.668775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.669056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.669328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.670069 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.671711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.683419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1291/2591] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:50:06.687748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.698372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93c71-7f04-40ba-b797-3232654c1cee admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.703226 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.704135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.704410 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.704684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] PATH_INFO: `/v3/projects/2a3cdfef63894dfaa496c6708d307442/users/7365bf6222224662a9a03c9702598a14/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.723202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3cdfef63894dfaa496c6708d307442, user_id=7365bf6222224662a9a03c9702598a14, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.726112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.741058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1301/2592] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:06 2022] PUT /identity/v3/projects/2a3cdfef63894dfaa496c6708d307442/users/7365bf6222224662a9a03c9702598a14/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:06.745877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.762186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9a9e2-0860-4be6-947c-ac57dd59ae71 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.794471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:06.846545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e026-c9f7-4e62-baa9-8d622989f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.847223 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e026-c9f7-4e62-baa9-8d622989f9fc admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.847508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e026-c9f7-4e62-baa9-8d622989f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.847784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e026-c9f7-4e62-baa9-8d622989f9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.848526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e026-c9f7-4e62-baa9-8d622989f9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.850150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e026-c9f7-4e62-baa9-8d622989f9fc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.873115 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1292/2593] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:06.876100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.882655 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:06.889339 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3ff4-b6ae-480c-bdb9-d98f2e382cc7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.895433 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.896442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.896651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.896938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] PATH_INFO: `/v3/projects/2a3cdfef63894dfaa496c6708d307442/users/7365bf6222224662a9a03c9702598a14/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.899089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3cdfef63894dfaa496c6708d307442, user_id=7365bf6222224662a9a03c9702598a14, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.902279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.921196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1302/2594] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:06 2022] PUT /identity/v3/projects/2a3cdfef63894dfaa496c6708d307442/users/7365bf6222224662a9a03c9702598a14/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:06.939756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.940047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.940497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.969253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] MFA Rules not processed for user `7365bf6222224662a9a03c9702598a14`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:06.970565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:07.073096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1293/2595] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:07.087015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.089474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:07.151350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a840-9172-44ca-9d8d-4ffb2fffff38 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.155263 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.155957 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.156253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.156520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.166975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.168509 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.179081 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1303/2596] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:50:07.237819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.239660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:07.256386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377fe23-f710-457a-ac41-a96ee1198b04 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.260607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5667949-a071-4716-b63f-8b25333a269c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.261295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5667949-a071-4716-b63f-8b25333a269c service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.261551 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5667949-a071-4716-b63f-8b25333a269c service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.261821 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5667949-a071-4716-b63f-8b25333a269c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.326426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5667949-a071-4716-b63f-8b25333a269c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.327871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5667949-a071-4716-b63f-8b25333a269c service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.338232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1294/2597] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:10.914540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:10.999724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09f39e-0860-4e8e-99c8-d55096046b00 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:11.004745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:11.005666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:11.005987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:11.006358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] PATH_INFO: `/v3/users/9c474a60c9454a44aa4ce05a7c6efe81` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:11.007731 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c474a60c9454a44aa4ce05a7c6efe81)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:11.011667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:11.078510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c474a60c9454a44aa4ce05a7c6efe81'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.092309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c474a60c9454a44aa4ce05a7c6efe81'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.099748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c474a60c9454a44aa4ce05a7c6efe81'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.108778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c474a60c9454a44aa4ce05a7c6efe81'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.109652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c474a60c9454a44aa4ce05a7c6efe81'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.116484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1304/2598] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:10 2022] DELETE /identity/v3/users/9c474a60c9454a44aa4ce05a7c6efe81 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:11.122021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:11.122575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:11.122697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:11.143037 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:11.144987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:11.201736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:11.226593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1295/2599] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:11.239663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:11.241166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:11.255692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:11.334407 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2446-7a22-490f-9b1e-43867a318f2e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:11.339617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:11.340352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:11.340642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:11.340925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:11.353649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:11.355493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:11.367351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1305/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:50:11.675507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:11.677081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:11.696004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b151c-e3a8-4e59-9619-5086ce3ef627 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:11.702791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:11.705055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:11.705571 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:11.706151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] PATH_INFO: `/v3/projects/0481b12a55a1444687239e97c420a56d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:11.709103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0481b12a55a1444687239e97c420a56d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:11.712083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:11.772918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0481b12a55a1444687239e97c420a56d', 'request_id': 'req-bafa6006-b643-48d3-b525-2aad345ca616'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.782217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0481b12a55a1444687239e97c420a56d', 'request_id': 'req-bafa6006-b643-48d3-b525-2aad345ca616'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.791341 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0481b12a55a1444687239e97c420a56d', 'request_id': 'req-bafa6006-b643-48d3-b525-2aad345ca616'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.809210 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] The token cache is being invalidate because project 0481b12a55a1444687239e97c420a56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:11.809559 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.810470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:11.812206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1296/2601] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:11 2022] DELETE /identity/v3/projects/0481b12a55a1444687239e97c420a56d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:11.816565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:11.827562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b2129-cc2f-4563-93a4-93cffdc07b9b service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:11.905086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:11.905881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:11.906161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:11.906463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] PATH_INFO: `/v3/users/7365bf6222224662a9a03c9702598a14` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:11.907736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7365bf6222224662a9a03c9702598a14)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:11.909671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:11.981862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7365bf6222224662a9a03c9702598a14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.001935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7365bf6222224662a9a03c9702598a14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.010465 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7365bf6222224662a9a03c9702598a14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.019027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7365bf6222224662a9a03c9702598a14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.019706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6c9c1636-195c-4ab8-aa1f-b4a0796f52ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7365bf6222224662a9a03c9702598a14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.027439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1306/2602] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:11 2022] DELETE /identity/v3/users/7365bf6222224662a9a03c9702598a14 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:12.376678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:12.379009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:12.394861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa6006-b643-48d3-b525-2aad345ca616 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:12.471611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:12.472482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:12.472771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:12.473045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] PATH_INFO: `/v3/projects/2a3cdfef63894dfaa496c6708d307442` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:12.474334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3cdfef63894dfaa496c6708d307442)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:12.476627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:12.537111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3cdfef63894dfaa496c6708d307442', 'request_id': 'req-b7a840be-14b1-4565-984b-efc3c31c8d01'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.546872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3cdfef63894dfaa496c6708d307442', 'request_id': 'req-b7a840be-14b1-4565-984b-efc3c31c8d01'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.555695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3cdfef63894dfaa496c6708d307442', 'request_id': 'req-b7a840be-14b1-4565-984b-efc3c31c8d01'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.565034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:12.572119 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] The token cache is being invalidate because project 2a3cdfef63894dfaa496c6708d307442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:12.572447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.573366 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b7a840be-14b1-4565-984b-efc3c31c8d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:12.575214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1297/2603] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:12 2022] DELETE /identity/v3/projects/2a3cdfef63894dfaa496c6708d307442 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:12.583486 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ec62a-fcbb-4e2c-82c9-c6c6a46e69db None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:12.583988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ec62a-fcbb-4e2c-82c9-c6c6a46e69db None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:12.584451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ec62a-fcbb-4e2c-82c9-c6c6a46e69db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:12.604392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ba8ec62a-fcbb-4e2c-82c9-c6c6a46e69db None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:12.605614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ba8ec62a-fcbb-4e2c-82c9-c6c6a46e69db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:12.641281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:12.694911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1307/2604] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:50:12.702920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924bb4-3b4f-4b5f-9e39-fc0851a7d964 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:12.703214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924bb4-3b4f-4b5f-9e39-fc0851a7d964 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:12.703501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924bb4-3b4f-4b5f-9e39-fc0851a7d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:12.730617 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f8924bb4-3b4f-4b5f-9e39-fc0851a7d964 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:12.731854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f8924bb4-3b4f-4b5f-9e39-fc0851a7d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:12.740206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1298/2605] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:12.745672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ec62a-fcbb-4e2c-82c9-c6c6a46e69db None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:12.756220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ec62a-fcbb-4e2c-82c9-c6c6a46e69db None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:12.761168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:12.761831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:12.762121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:12.762432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:12.763166 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:50:12.763475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:12.765091 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:12.778218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1308/2606] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:50:12.782699 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8924bb4-3b4f-4b5f-9e39-fc0851a7d964 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:12.792830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8924bb4-3b4f-4b5f-9e39-fc0851a7d964 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:12.797775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:12.798482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:12.798769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:12.799048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:12.799770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:12.801684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:12.832461 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1299/2607] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:50:12.836738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:12.852178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0d28a-62fc-4bd3-9747-216151d4eda5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:12.922440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:12.923192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:12.923475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:12.923755 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:12.924456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:12.926493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:12.957014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1309/2608] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:12 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:12.961994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:12.973645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5991a-56ad-4f44-bb5e-1d8656a2db4b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:12.982679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:12.984683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:12.984966 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:12.985243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:12.986002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:12.987690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.000573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1300/2609] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:13.004792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.016783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fdeaa-eb62-4acd-9430-df1b8459d8b8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.022760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162690b9-3e35-4399-8117-b36df0af36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.023476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162690b9-3e35-4399-8117-b36df0af36fa admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.023784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162690b9-3e35-4399-8117-b36df0af36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.024070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162690b9-3e35-4399-8117-b36df0af36fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.025343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162690b9-3e35-4399-8117-b36df0af36fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.027180 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162690b9-3e35-4399-8117-b36df0af36fa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.038490 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1310/2610] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:13.047316 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.059752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9736bd-81b3-4b77-b84e-2dc88cdcb462 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.064636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.065688 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.065973 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.066284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] PATH_INFO: `/v3/projects/a32da473446f4f41bc5852fcc6979b4a/users/991bdeac3d664be0b502b603f2c0baa6/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.088452 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32da473446f4f41bc5852fcc6979b4a, user_id=991bdeac3d664be0b502b603f2c0baa6, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.091209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.106217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1301/2611] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:13 2022] PUT /identity/v3/projects/a32da473446f4f41bc5852fcc6979b4a/users/991bdeac3d664be0b502b603f2c0baa6/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:13.125099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7a0f-34a1-4d9f-ac8e-fd74052e9e69 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.125454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7a0f-34a1-4d9f-ac8e-fd74052e9e69 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.125828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7a0f-34a1-4d9f-ac8e-fd74052e9e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.169435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d2c7a0f-34a1-4d9f-ac8e-fd74052e9e69 None None] MFA Rules not processed for user `991bdeac3d664be0b502b603f2c0baa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:13.171275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d2c7a0f-34a1-4d9f-ac8e-fd74052e9e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:13.247849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1311/2612] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:13.252427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.338035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c130e-69fb-4b76-a6eb-883aef3835b0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.343401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.344101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.344377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.344655 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.345363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.347590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.389739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1302/2613] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:13 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:13.395012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c7a0f-34a1-4d9f-ac8e-fd74052e9e69 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.410029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c7a0f-34a1-4d9f-ac8e-fd74052e9e69 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.441453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:13.494747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.495838 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.496179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.496678 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.497796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.500475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.526886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1312/2614] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:13 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:13.532599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.544077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890583-467a-4fc8-8230-c21c359d55e9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.549133 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.549828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.550114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.550428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.551207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.552926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.565868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1303/2615] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:50:13.570586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.582836 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7d57-3b20-478b-bf80-1fbbf5b96b17 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.588090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.589076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.589365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.589651 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] PATH_INFO: `/v3/projects/099354698d294b00bb9f741121f590a2/users/096135e764054f99b62e2267511aefda/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.608844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099354698d294b00bb9f741121f590a2, user_id=096135e764054f99b62e2267511aefda, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.611672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.627005 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1313/2616] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:13 2022] PUT /identity/v3/projects/099354698d294b00bb9f741121f590a2/users/096135e764054f99b62e2267511aefda/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:13.631591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.647858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d7062-ddfe-47be-b966-8492565d5228 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.744361 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d38dd4-0eff-4852-b416-cd3f5a90fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.745174 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d38dd4-0eff-4852-b416-cd3f5a90fc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.745607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d38dd4-0eff-4852-b416-cd3f5a90fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.745967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d38dd4-0eff-4852-b416-cd3f5a90fc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.746764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d38dd4-0eff-4852-b416-cd3f5a90fc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.748418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d38dd4-0eff-4852-b416-cd3f5a90fc73 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.765264 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1304/2617] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:50:13.769478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.787908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadff7f-36a5-451e-a1b9-cd33fc45c8e1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:13.796217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:13.797662 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.798139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.798626 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] PATH_INFO: `/v3/projects/099354698d294b00bb9f741121f590a2/users/096135e764054f99b62e2267511aefda/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.801574 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=099354698d294b00bb9f741121f590a2, user_id=096135e764054f99b62e2267511aefda, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:13.804246 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:13.819921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1314/2618] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:13 2022] PUT /identity/v3/projects/099354698d294b00bb9f741121f590a2/users/096135e764054f99b62e2267511aefda/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:13.837483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9e917-40d6-484d-87a7-b7a56e2f72a6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:13.837855 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9e917-40d6-484d-87a7-b7a56e2f72a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:13.838280 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9e917-40d6-484d-87a7-b7a56e2f72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:13.849738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:13.880010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3cd9e917-40d6-484d-87a7-b7a56e2f72a6 None None] MFA Rules not processed for user `096135e764054f99b62e2267511aefda`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:13.881325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3cd9e917-40d6-484d-87a7-b7a56e2f72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:13.963678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1305/2619] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:13.977298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:13.980618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:14.048116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984a222-5f87-4bb2-8159-2506897bab4e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:14.052187 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ca24a-c523-422f-88ae-ed6a84a5e261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:14.052928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca24a-c523-422f-88ae-ed6a84a5e261 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:14.053216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca24a-c523-422f-88ae-ed6a84a5e261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:14.053495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca24a-c523-422f-88ae-ed6a84a5e261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:14.064544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ca24a-c523-422f-88ae-ed6a84a5e261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:14.066122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ca24a-c523-422f-88ae-ed6a84a5e261 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:14.077148 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1315/2620] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:14.122464 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9e917-40d6-484d-87a7-b7a56e2f72a6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:14.205074 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9e917-40d6-484d-87a7-b7a56e2f72a6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:14.210526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:14.211425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:14.211719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:14.211995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] PATH_INFO: `/v3/users/991bdeac3d664be0b502b603f2c0baa6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:14.213842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=991bdeac3d664be0b502b603f2c0baa6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:14.216987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:14.284120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991bdeac3d664be0b502b603f2c0baa6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:14.285106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991bdeac3d664be0b502b603f2c0baa6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:14.295403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991bdeac3d664be0b502b603f2c0baa6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:14.296205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991bdeac3d664be0b502b603f2c0baa6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:14.307181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991bdeac3d664be0b502b603f2c0baa6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:14.327386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1306/2621] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:14 2022] DELETE /identity/v3/users/991bdeac3d664be0b502b603f2c0baa6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:14.332406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:14.332692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:14.332973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:14.353525 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:14.354782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:14.440121 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1316/2622] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:14.455124 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:14.457345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:14.476403 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:14.548785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188dcb2-3f07-4f64-99eb-eb2eded02c7e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:14.553191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:14.553895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:14.554203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:14.554494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:14.565282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:14.566687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:14.578103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1307/2623] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:14.901170 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:14.903219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:14.921848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec281-1913-4d89-847e-8ee492bf593e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:14.927186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:14.928132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:14.928419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:14.928734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] PATH_INFO: `/v3/projects/a32da473446f4f41bc5852fcc6979b4a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:14.930322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32da473446f4f41bc5852fcc6979b4a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:14.932467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:14.964883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:14.997207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32da473446f4f41bc5852fcc6979b4a', 'request_id': 'req-b30540a6-3891-4a9a-90ef-328ba74efffd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.004781 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32da473446f4f41bc5852fcc6979b4a', 'request_id': 'req-b30540a6-3891-4a9a-90ef-328ba74efffd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.012609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32da473446f4f41bc5852fcc6979b4a', 'request_id': 'req-b30540a6-3891-4a9a-90ef-328ba74efffd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.027461 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] The token cache is being invalidate because project a32da473446f4f41bc5852fcc6979b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:15.027756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.028508 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.030340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1317/2624] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:14 2022] DELETE /identity/v3/projects/a32da473446f4f41bc5852fcc6979b4a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:15.035667 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:15.053396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d5285-2611-425c-ac00-cbed98378d16 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:15.139056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:15.139887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:15.140181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:15.140463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] PATH_INFO: `/v3/users/096135e764054f99b62e2267511aefda` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:15.141755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096135e764054f99b62e2267511aefda)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:15.143903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:15.208008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096135e764054f99b62e2267511aefda'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.208917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096135e764054f99b62e2267511aefda'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.217517 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096135e764054f99b62e2267511aefda'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.218358 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096135e764054f99b62e2267511aefda'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.228685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2c2b8f9b-d13e-475c-aeaf-6944e574b388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096135e764054f99b62e2267511aefda'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.262825 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1308/2625] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:15 2022] DELETE /identity/v3/users/096135e764054f99b62e2267511aefda => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:15.614500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:15.616020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:15.630349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30540a6-3891-4a9a-90ef-328ba74efffd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:15.701597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:15.702493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:15.702919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:15.703288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] PATH_INFO: `/v3/projects/099354698d294b00bb9f741121f590a2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:15.706899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=099354698d294b00bb9f741121f590a2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:15.708714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:15.780417 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099354698d294b00bb9f741121f590a2', 'request_id': 'req-5144d405-6b5e-457d-93da-f70efb15eb1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.787608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099354698d294b00bb9f741121f590a2', 'request_id': 'req-5144d405-6b5e-457d-93da-f70efb15eb1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.794936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099354698d294b00bb9f741121f590a2', 'request_id': 'req-5144d405-6b5e-457d-93da-f70efb15eb1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.809581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] The token cache is being invalidate because project 099354698d294b00bb9f741121f590a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:15.809868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.810558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5144d405-6b5e-457d-93da-f70efb15eb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:15.812226 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1318/2626] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:15 2022] DELETE /identity/v3/projects/099354698d294b00bb9f741121f590a2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:15.818459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164aba2-f25e-44bb-930f-b2239a4702eb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:15.819043 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164aba2-f25e-44bb-930f-b2239a4702eb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:15.819299 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164aba2-f25e-44bb-930f-b2239a4702eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:15.843368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e164aba2-f25e-44bb-930f-b2239a4702eb None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:15.844600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e164aba2-f25e-44bb-930f-b2239a4702eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:15.874885 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:15.921873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1309/2627] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:15.930466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9e02c-19a5-446a-a212-bca3fa28414c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:15.931428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9e02c-19a5-446a-a212-bca3fa28414c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:15.931716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9e02c-19a5-446a-a212-bca3fa28414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:15.952101 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dce9e02c-19a5-446a-a212-bca3fa28414c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:15.953431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dce9e02c-19a5-446a-a212-bca3fa28414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:15.962811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1319/2628] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:15.967470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164aba2-f25e-44bb-930f-b2239a4702eb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:15.984269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164aba2-f25e-44bb-930f-b2239a4702eb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:15.991334 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:15.992198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:15.992646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:15.992983 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:15.993954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:50:15.994364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:15.996962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.016595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1310/2629] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:50:16.022432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9e02c-19a5-446a-a212-bca3fa28414c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.033335 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9e02c-19a5-446a-a212-bca3fa28414c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.038552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.039234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.039526 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.039783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.040567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.042497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.078762 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1320/2630] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:16 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:16.089383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.102450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34656d83-70b9-4d8f-b12b-3cbffe91b4b5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.171419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.172544 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.172935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.173404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.174712 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.178506 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.209520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1311/2631] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:16 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:16.216029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.228628 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fc239-ff07-4ea8-8f19-25033012d145 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.233881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.234682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.235011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.235387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.236225 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.237939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.240864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:16.253359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1321/2632] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:16.258733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.273703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca934-e675-4f00-b259-e5cc0c6146e4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.279388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a968bc-2d70-4adb-9ecb-1dd475a8aa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.280273 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a968bc-2d70-4adb-9ecb-1dd475a8aa25 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.280678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a968bc-2d70-4adb-9ecb-1dd475a8aa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.281168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a968bc-2d70-4adb-9ecb-1dd475a8aa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.282565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a968bc-2d70-4adb-9ecb-1dd475a8aa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.284290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a968bc-2d70-4adb-9ecb-1dd475a8aa25 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.296373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1312/2633] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:16.301522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.317796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376ba16-2ea9-40c5-a569-1af4644b17e9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.325071 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.326635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.326933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.327235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] PATH_INFO: `/v3/projects/1529cf69234c499698d9cc44f72d0a23/users/d25bf57be56a48f0a7f461d8f3888bba/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.352462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1529cf69234c499698d9cc44f72d0a23, user_id=d25bf57be56a48f0a7f461d8f3888bba, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.355672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.374375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1322/2634] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:16 2022] PUT /identity/v3/projects/1529cf69234c499698d9cc44f72d0a23/users/d25bf57be56a48f0a7f461d8f3888bba/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:16.386504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a381d01-a149-43b8-a99c-8ff3d5fd9ff8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.386804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a381d01-a149-43b8-a99c-8ff3d5fd9ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.387072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a381d01-a149-43b8-a99c-8ff3d5fd9ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.426417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9a381d01-a149-43b8-a99c-8ff3d5fd9ff8 None None] MFA Rules not processed for user `d25bf57be56a48f0a7f461d8f3888bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:16.428339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9a381d01-a149-43b8-a99c-8ff3d5fd9ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:16.521401 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1313/2635] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:16.526812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.602667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900db7-75d4-46a4-aa85-e7089e1d5280 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.611458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.612459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.612857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.613204 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.614400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.616887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.647291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1323/2636] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:16 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:50:16.654103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a381d01-a149-43b8-a99c-8ff3d5fd9ff8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.666708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a381d01-a149-43b8-a99c-8ff3d5fd9ff8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.700039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:16.742843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.743590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.743872 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.744162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.744932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.746988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.770203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1314/2637] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:16 2022] POST /identity/v3/users => generated 301 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:16.775388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.793252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee031b6-41b7-4047-8a2f-2f5ff253591a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.798614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.799353 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.799649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.799917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.800687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.802435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.815822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1324/2638] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:16.822612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.840814 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd403e-e137-4482-a078-ef050999844d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.847620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.848681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.848964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.849241 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] PATH_INFO: `/v3/projects/ace0aa5470294aa1b305065d4aaf1115/users/59ec4154edf741128c6d4f55b5a8f874/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.870686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace0aa5470294aa1b305065d4aaf1115, user_id=59ec4154edf741128c6d4f55b5a8f874, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.874730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.900693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1315/2639] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:16 2022] PUT /identity/v3/projects/ace0aa5470294aa1b305065d4aaf1115/users/59ec4154edf741128c6d4f55b5a8f874/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:16.905197 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.917902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb16d-4287-427a-b1f2-4d0bb9b39d82 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.987403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff71cf-8783-465b-9049-097a470d3845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.988010 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff71cf-8783-465b-9049-097a470d3845 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.988295 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff71cf-8783-465b-9049-097a470d3845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.988575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff71cf-8783-465b-9049-097a470d3845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.989315 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff71cf-8783-465b-9049-097a470d3845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.990978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff71cf-8783-465b-9049-097a470d3845 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:17.001816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1325/2640] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:50:17.006689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:17.019004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309953-2aae-4f99-8525-3cf72a89b5a0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:17.024186 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:17.025659 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:17.025937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:17.026233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] PATH_INFO: `/v3/projects/ace0aa5470294aa1b305065d4aaf1115/users/59ec4154edf741128c6d4f55b5a8f874/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:17.028760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace0aa5470294aa1b305065d4aaf1115, user_id=59ec4154edf741128c6d4f55b5a8f874, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:17.033022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:17.051572 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1316/2641] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:17 2022] PUT /identity/v3/projects/ace0aa5470294aa1b305065d4aaf1115/users/59ec4154edf741128c6d4f55b5a8f874/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:17.063504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223234-731a-48cd-a1a1-c2faf2d55622 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:17.064065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223234-731a-48cd-a1a1-c2faf2d55622 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:17.064522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223234-731a-48cd-a1a1-c2faf2d55622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:17.100079 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a4223234-731a-48cd-a1a1-c2faf2d55622 None None] MFA Rules not processed for user `59ec4154edf741128c6d4f55b5a8f874`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:17.101584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a4223234-731a-48cd-a1a1-c2faf2d55622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:17.144276 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:17.192649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1326/2642] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:17.205922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:17.208666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:17.292502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838765d1-3507-46cf-b2ea-db40dfe63eaf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:17.298573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127ef45-04a6-4b07-9f6a-4e84ed7ca0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:17.299697 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127ef45-04a6-4b07-9f6a-4e84ed7ca0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:17.300196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127ef45-04a6-4b07-9f6a-4e84ed7ca0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:17.300685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127ef45-04a6-4b07-9f6a-4e84ed7ca0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:17.316382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127ef45-04a6-4b07-9f6a-4e84ed7ca0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:17.317881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127ef45-04a6-4b07-9f6a-4e84ed7ca0c1 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:17.329950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1317/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:17.490560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4223234-731a-48cd-a1a1-c2faf2d55622 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:17.559620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4223234-731a-48cd-a1a1-c2faf2d55622 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:17.567982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:17.568881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:17.569162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:17.569432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] PATH_INFO: `/v3/users/d25bf57be56a48f0a7f461d8f3888bba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:17.570705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25bf57be56a48f0a7f461d8f3888bba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:17.573459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:17.631041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25bf57be56a48f0a7f461d8f3888bba'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:17.645375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25bf57be56a48f0a7f461d8f3888bba'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:17.654145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25bf57be56a48f0a7f461d8f3888bba'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:17.664043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25bf57be56a48f0a7f461d8f3888bba'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:17.664848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25bf57be56a48f0a7f461d8f3888bba'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:17.671879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1327/2644] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:17 2022] DELETE /identity/v3/users/d25bf57be56a48f0a7f461d8f3888bba => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:17.676883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:17.677166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:17.677439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:17.696979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:17.698245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:17.773063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1318/2645] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:17.783713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:17.785223 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:17.851615 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:17.857002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62b86-d1a7-4a49-a0bb-6f5a57102319 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:17.862905 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:17.864265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:17.864785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:17.865501 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:17.876885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:17.878400 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:17.891044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1328/2646] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:18.188708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:18.190249 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:18.207225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70f8d-584b-4b7d-b2cd-9b3c878adb31 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:18.214908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:18.216231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:18.217343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:18.217343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] PATH_INFO: `/v3/projects/1529cf69234c499698d9cc44f72d0a23` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:18.223364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1529cf69234c499698d9cc44f72d0a23)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:18.227362 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:18.247380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:18.294328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1529cf69234c499698d9cc44f72d0a23', 'request_id': 'req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.303048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1529cf69234c499698d9cc44f72d0a23', 'request_id': 'req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.309746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1529cf69234c499698d9cc44f72d0a23', 'request_id': 'req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.326459 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] The token cache is being invalidate because project 1529cf69234c499698d9cc44f72d0a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:18.326732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.327435 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.329052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1319/2647] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:18 2022] DELETE /identity/v3/projects/1529cf69234c499698d9cc44f72d0a23 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:18.333338 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:18.346667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fab74-fdd6-4db5-900c-59a11c69febb service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:18.413239 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:18.414214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:18.414492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:18.414768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] PATH_INFO: `/v3/users/59ec4154edf741128c6d4f55b5a8f874` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:18.416659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ec4154edf741128c6d4f55b5a8f874)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:18.418652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:18.495319 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ec4154edf741128c6d4f55b5a8f874'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.507390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ec4154edf741128c6d4f55b5a8f874'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.515833 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ec4154edf741128c6d4f55b5a8f874'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.526357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ec4154edf741128c6d4f55b5a8f874'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.527122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7e484c59-c6da-4343-946d-7e7ebf03d310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ec4154edf741128c6d4f55b5a8f874'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:18.536671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1329/2648] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:18 2022] DELETE /identity/v3/users/59ec4154edf741128c6d4f55b5a8f874 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:18.903533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:18.905244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:18.922586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e4bb-24a4-4251-ae73-de96f9aca7c7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.013706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.015237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.015729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.016222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] PATH_INFO: `/v3/projects/ace0aa5470294aa1b305065d4aaf1115` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.018423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace0aa5470294aa1b305065d4aaf1115)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.022061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.096015 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace0aa5470294aa1b305065d4aaf1115', 'request_id': 'req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:19.105775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace0aa5470294aa1b305065d4aaf1115', 'request_id': 'req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:19.119854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace0aa5470294aa1b305065d4aaf1115', 'request_id': 'req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:19.134840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] The token cache is being invalidate because project ace0aa5470294aa1b305065d4aaf1115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:19.135332 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:19.136607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3cb3a7e6-c8b0-49e1-b5e8-5826ead1d121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:19.139215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1320/2649] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:18 2022] DELETE /identity/v3/projects/ace0aa5470294aa1b305065d4aaf1115 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:19.144382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b124d-3242-4f1b-b6c1-edf9d2d5bb24 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.145049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b124d-3242-4f1b-b6c1-edf9d2d5bb24 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.145049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b124d-3242-4f1b-b6c1-edf9d2d5bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.166199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d6b124d-3242-4f1b-b6c1-edf9d2d5bb24 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:19.167480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d6b124d-3242-4f1b-b6c1-edf9d2d5bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:19.238350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1330/2650] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:19.248534 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779f99-6f08-46c9-9eb3-7e1166e58e0d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.249323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779f99-6f08-46c9-9eb3-7e1166e58e0d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.249447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779f99-6f08-46c9-9eb3-7e1166e58e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.271580 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-71779f99-6f08-46c9-9eb3-7e1166e58e0d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:19.272877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-71779f99-6f08-46c9-9eb3-7e1166e58e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:19.284471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1321/2651] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:19.289681 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b124d-3242-4f1b-b6c1-edf9d2d5bb24 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.308848 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b124d-3242-4f1b-b6c1-edf9d2d5bb24 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.314545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.315231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.315524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.315807 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.316564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:50:19.316928 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.318567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.327023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:19.335817 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1331/2652] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:50:19.341494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71779f99-6f08-46c9-9eb3-7e1166e58e0d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.353000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71779f99-6f08-46c9-9eb3-7e1166e58e0d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.359661 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.360466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.360800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.361083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.362292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.364887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.406029 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1322/2653] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:19 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:50:19.407379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.421691 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60679-9362-470e-8fb8-05b01d93f7cd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.493186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.494333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.495218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.496020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.497409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.502391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.527493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1332/2654] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:19 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:19.531663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.544045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443b97b-0fa3-4ac9-947f-f63f30ca0469 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.548968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.549645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.549934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.550233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.550978 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.552601 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.554306 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:19.566097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1323/2655] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:19.570570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.587871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb1ff-a7d9-424d-af9d-6bc74efca094 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.597456 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb323-f23d-49e0-8740-610bc36964f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.598642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb323-f23d-49e0-8740-610bc36964f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.599124 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb323-f23d-49e0-8740-610bc36964f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.599608 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb323-f23d-49e0-8740-610bc36964f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.601224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb323-f23d-49e0-8740-610bc36964f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.604932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb323-f23d-49e0-8740-610bc36964f2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.624612 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1333/2656] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:19.629205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.640227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cefaf-6035-4412-bea6-da365619d84a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.646445 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.647371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.647658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.647934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] PATH_INFO: `/v3/projects/24370b629f804ae9a38ff8edae584e41/users/f1efa6d6fedb443bab7f1eef24b2ecae/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.665979 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24370b629f804ae9a38ff8edae584e41, user_id=f1efa6d6fedb443bab7f1eef24b2ecae, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.670093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.686342 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1324/2657] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:19 2022] PUT /identity/v3/projects/24370b629f804ae9a38ff8edae584e41/users/f1efa6d6fedb443bab7f1eef24b2ecae/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:19.697100 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027594b-0193-4742-a4e0-c40ed470268a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.697436 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027594b-0193-4742-a4e0-c40ed470268a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.697764 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027594b-0193-4742-a4e0-c40ed470268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.728084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3027594b-0193-4742-a4e0-c40ed470268a None None] MFA Rules not processed for user `f1efa6d6fedb443bab7f1eef24b2ecae`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:19.729359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3027594b-0193-4742-a4e0-c40ed470268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:19.828824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1334/2658] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:50:19.847193 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.849463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:19.930575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a0b5-8501-455b-a4bd-f69a837f132b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.934510 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788772fe-cae8-4f94-a9ca-1add5dc46aad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164a361891274af1b20fe7b7458ecde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.935173 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788772fe-cae8-4f94-a9ca-1add5dc46aad service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.935457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788772fe-cae8-4f94-a9ca-1add5dc46aad service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.935771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788772fe-cae8-4f94-a9ca-1add5dc46aad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.944962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788772fe-cae8-4f94-a9ca-1add5dc46aad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.947634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788772fe-cae8-4f94-a9ca-1add5dc46aad service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.959113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1325/2659] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:29.821951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:29.954030 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:50.562867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027594b-0193-4742-a4e0-c40ed470268a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:50.628977 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027594b-0193-4742-a4e0-c40ed470268a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:50.633544 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:50.634460 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:50.634745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:50.635023 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] PATH_INFO: `/v3/users/f1efa6d6fedb443bab7f1eef24b2ecae` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:50.636245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1efa6d6fedb443bab7f1eef24b2ecae)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:50.638202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:50.693650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1efa6d6fedb443bab7f1eef24b2ecae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:50.711757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1efa6d6fedb443bab7f1eef24b2ecae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:50.718976 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1efa6d6fedb443bab7f1eef24b2ecae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:50.728134 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1efa6d6fedb443bab7f1eef24b2ecae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:50.728806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1efa6d6fedb443bab7f1eef24b2ecae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:50.737960 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1335/2660] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:50 2022] DELETE /identity/v3/users/f1efa6d6fedb443bab7f1eef24b2ecae => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:50.743104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:50.743602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:50.743701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:50.763732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:50.764873 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:50.827331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1326/2661] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:50.837162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:50.838694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:50.900279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64711d8b-97fa-4103-a577-cccc7f542d94 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:50.904038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ec1f1-03be-465d-959b-7b3ffdd08522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:50.904688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec1f1-03be-465d-959b-7b3ffdd08522 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:50.904971 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec1f1-03be-465d-959b-7b3ffdd08522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:50.905249 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec1f1-03be-465d-959b-7b3ffdd08522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:50.916446 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ec1f1-03be-465d-959b-7b3ffdd08522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:50.918110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ec1f1-03be-465d-959b-7b3ffdd08522 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:50.928754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1336/2662] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:51.233247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.235244 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:51.250000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8fede-b4f7-4873-af08-c95b4f0151af None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.255668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.256945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.257393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.257883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] PATH_INFO: `/v3/projects/24370b629f804ae9a38ff8edae584e41` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.262228 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24370b629f804ae9a38ff8edae584e41)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.262738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:51.313703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24370b629f804ae9a38ff8edae584e41', 'request_id': 'req-39c979dd-14d8-4938-a811-2778ee6f1da4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:51.322080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24370b629f804ae9a38ff8edae584e41', 'request_id': 'req-39c979dd-14d8-4938-a811-2778ee6f1da4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:51.328721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24370b629f804ae9a38ff8edae584e41', 'request_id': 'req-39c979dd-14d8-4938-a811-2778ee6f1da4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:51.344859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] The token cache is being invalidate because project 24370b629f804ae9a38ff8edae584e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:51.345149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:51.347779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39c979dd-14d8-4938-a811-2778ee6f1da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:51.347779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1327/2663] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:51 2022] DELETE /identity/v3/projects/24370b629f804ae9a38ff8edae584e41 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:51.353088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7751d4-dcfc-484d-b7cf-b1223d1d8b67 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.353427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7751d4-dcfc-484d-b7cf-b1223d1d8b67 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.353748 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7751d4-dcfc-484d-b7cf-b1223d1d8b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.371514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ee7751d4-dcfc-484d-b7cf-b1223d1d8b67 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:51.372720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ee7751d4-dcfc-484d-b7cf-b1223d1d8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:51.389958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:51.438551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1337/2664] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:51.446926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420994d-cda5-45f8-85bb-e4297b47fa32 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.447222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420994d-cda5-45f8-85bb-e4297b47fa32 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.447504 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420994d-cda5-45f8-85bb-e4297b47fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.467064 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c420994d-cda5-45f8-85bb-e4297b47fa32 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:51.468324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c420994d-cda5-45f8-85bb-e4297b47fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:51.476977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1328/2665] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:51.481380 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7751d4-dcfc-484d-b7cf-b1223d1d8b67 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.491392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7751d4-dcfc-484d-b7cf-b1223d1d8b67 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.496699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.496823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.497076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.497358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.498082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:50:51.498429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.500029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:51.513270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1338/2666] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:50:51.517660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420994d-cda5-45f8-85bb-e4297b47fa32 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.527980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420994d-cda5-45f8-85bb-e4297b47fa32 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.532927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.533577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.533857 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.534128 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.534900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.536796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:51.570729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1329/2667] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:51 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:51.572193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.582907 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17650b2d-80f9-459e-85e7-64646eaffb84 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.651365 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.652044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.652327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.652603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.653300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.655236 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:51.675609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1339/2668] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:51 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:51.680496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.691127 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becd973-905b-49e5-8179-d45d0e299f74 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.697409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.698089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.698404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.698680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.699422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.701035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:51.714153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1330/2669] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:51.718711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.729375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b4834-e78c-475a-a0b9-8905da61f8e8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.734056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d15a8-e3b2-48fe-bba2-c1d17ecf7956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.734766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d15a8-e3b2-48fe-bba2-c1d17ecf7956 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.735052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d15a8-e3b2-48fe-bba2-c1d17ecf7956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.735334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d15a8-e3b2-48fe-bba2-c1d17ecf7956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.736067 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d15a8-e3b2-48fe-bba2-c1d17ecf7956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.737659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d15a8-e3b2-48fe-bba2-c1d17ecf7956 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:51.751068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1340/2670] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:51.752939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.763929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39e27a-0a20-4a12-816b-a96af7b11dd3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.768639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.769533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.769816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.770093 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] PATH_INFO: `/v3/projects/fdc4ba4ddb5f484195bc0a0aab9f2623/users/f086e831a425416ba41e7e54ed74e2c9/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.785147 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc4ba4ddb5f484195bc0a0aab9f2623, user_id=f086e831a425416ba41e7e54ed74e2c9, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.787876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:51.801104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1331/2671] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:51 2022] PUT /identity/v3/projects/fdc4ba4ddb5f484195bc0a0aab9f2623/users/f086e831a425416ba41e7e54ed74e2c9/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:51.812535 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309062a7-3f42-4c18-b772-45f267787e7d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.812832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309062a7-3f42-4c18-b772-45f267787e7d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.813117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309062a7-3f42-4c18-b772-45f267787e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.842216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-309062a7-3f42-4c18-b772-45f267787e7d None None] MFA Rules not processed for user `f086e831a425416ba41e7e54ed74e2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:51.843629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-309062a7-3f42-4c18-b772-45f267787e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:51.908815 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1341/2672] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:51.919690 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:51.921436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:51.944447 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:51.983735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e41c-8c8f-4a63-9e7e-3b0a094eee82 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:51.987400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c31d7-04cf-4594-bcb7-c2538257c23c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:51.988050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c31d7-04cf-4594-bcb7-c2538257c23c service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:51.988335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c31d7-04cf-4594-bcb7-c2538257c23c service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:51.988616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c31d7-04cf-4594-bcb7-c2538257c23c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:51.997613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c31d7-04cf-4594-bcb7-c2538257c23c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:51.999081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c31d7-04cf-4594-bcb7-c2538257c23c service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:52.008442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1332/2673] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:55.099482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309062a7-3f42-4c18-b772-45f267787e7d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:55.118609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:55.165941 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309062a7-3f42-4c18-b772-45f267787e7d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:55.170467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:55.171341 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:55.171624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:55.171901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] PATH_INFO: `/v3/users/f086e831a425416ba41e7e54ed74e2c9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:55.173087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f086e831a425416ba41e7e54ed74e2c9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:55.175018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:55.240775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f086e831a425416ba41e7e54ed74e2c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:55.252714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f086e831a425416ba41e7e54ed74e2c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:55.260096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f086e831a425416ba41e7e54ed74e2c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:55.267205 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f086e831a425416ba41e7e54ed74e2c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:55.267911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f086e831a425416ba41e7e54ed74e2c9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:55.273997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1342/2674] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:55 2022] DELETE /identity/v3/users/f086e831a425416ba41e7e54ed74e2c9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:55.279419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:55.279900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:55.280011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:55.297609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:55.298850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:55.361409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1333/2675] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:55.371952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:55.373585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:55.436955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ddf45-33c2-47f0-925e-f77a0b611356 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:55.440624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:55.441285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:55.441570 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:55.441851 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:55.453348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:55.454821 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:55.464867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1343/2676] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:55.990976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:55.992680 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:56.009416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e11b5-8acd-4cf5-b896-b68d88950523 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:56.016431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:56.017959 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:56.018489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:56.018997 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] PATH_INFO: `/v3/projects/fdc4ba4ddb5f484195bc0a0aab9f2623` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:56.021082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc4ba4ddb5f484195bc0a0aab9f2623)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:56.024991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:56.074950 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc4ba4ddb5f484195bc0a0aab9f2623', 'request_id': 'req-2320ec2d-6400-430d-829b-d759487bfb60'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:56.082971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc4ba4ddb5f484195bc0a0aab9f2623', 'request_id': 'req-2320ec2d-6400-430d-829b-d759487bfb60'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:56.091198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc4ba4ddb5f484195bc0a0aab9f2623', 'request_id': 'req-2320ec2d-6400-430d-829b-d759487bfb60'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:56.109320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] The token cache is being invalidate because project fdc4ba4ddb5f484195bc0a0aab9f2623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:56.109613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:56.110302 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:56.111865 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1334/2677] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:55 2022] DELETE /identity/v3/projects/fdc4ba4ddb5f484195bc0a0aab9f2623 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:56.403232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:56.414917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c79e-b503-4bec-a9e7-fe7e77353e78 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:56.458997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:56.472541 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14286ae5-58f9-4784-93d5-14199f76a09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:56.473375 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286ae5-58f9-4784-93d5-14199f76a09c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:56.473758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286ae5-58f9-4784-93d5-14199f76a09c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:56.474143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286ae5-58f9-4784-93d5-14199f76a09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:56.476418 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-14286ae5-58f9-4784-93d5-14199f76a09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:56.488255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14286ae5-58f9-4784-93d5-14199f76a09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:56.489727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14286ae5-58f9-4784-93d5-14199f76a09c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:56.498805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1344/2678] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:03.433486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:03.435479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:03.495232 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:03.541164 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ec2d-6400-430d-829b-d759487bfb60 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:03.551130 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:03.552267 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:03.552773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:03.553258 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:03.556444 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:03.671417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:03.673125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:03.694837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1335/2679] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:51:06.494959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:13.691835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=48 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:20.270559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:20.271163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:20.271163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:20.301028 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] MFA Rules not processed for user `bdb0530980a146d19e0b2f68bdc0fa53`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:20.302448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:20.309996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1345/2680] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:52:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:20.648957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:20.650430 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:20.664803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7f05-28c6-4631-9fa5-adcff7bb80e1 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:20.668501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167769eb-059f-4898-be68-834cb131512f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:20.669182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167769eb-059f-4898-be68-834cb131512f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:20.669467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167769eb-059f-4898-be68-834cb131512f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:20.669745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167769eb-059f-4898-be68-834cb131512f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:20.671686 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-167769eb-059f-4898-be68-834cb131512f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:20.682732 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167769eb-059f-4898-be68-834cb131512f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:20.684217 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167769eb-059f-4898-be68-834cb131512f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:20.693897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1336/2681] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:30.298491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:30.689344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:03.689112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:03.691031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:03.833036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214532c-172d-414f-8dc2-5994db541f96 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:03.838949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:03.839618 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:03.839903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:03.840181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:03.842040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:03.855318 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:03.857196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:03.869190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1346/2682] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:13.863624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=50 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:59.984681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167769eb-059f-4898-be68-834cb131512f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:59.986402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-167769eb-059f-4898-be68-834cb131512f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:00.045385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167769eb-059f-4898-be68-834cb131512f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:00.049100 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:00.049789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:00.050072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:00.050387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:00.052218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:00.066467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:00.067894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:00.078751 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1337/2683] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:08.095522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:08.105108 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e596e-2dc5-40f3-bedc-c538338a88a7 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:08.108768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:08.109409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:08.109698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:08.109981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:08.111798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:08.125565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:08.127024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:08.138556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1347/2684] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:10.073898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=26 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:18.134379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:21.175615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:21.184905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547387-1d93-415d-a3c2-5b68e62db77e service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:21.188673 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:21.189304 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:21.189587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:21.189858 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:21.191656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:21.255377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:21.256804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:21.266434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1338/2685] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:24.451517 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.456669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:24.470017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8044e0-5118-44ca-b555-893f14f6fdd8 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.475818 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.476715 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.477156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.478138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.480873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:24.494245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.495975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.517478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.528284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:24.535212 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1348/2686] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:24.542789 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5055b-6d5d-4aff-9bed-a11c772fdf16 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.547645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.548536 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.548823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.549104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] PATH_INFO: `/v3/users/bdb0530980a146d19e0b2f68bdc0fa53` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.550643 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb0530980a146d19e0b2f68bdc0fa53)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.552600 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.606298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb0530980a146d19e0b2f68bdc0fa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.607200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb0530980a146d19e0b2f68bdc0fa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.615408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb0530980a146d19e0b2f68bdc0fa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.616111 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb0530980a146d19e0b2f68bdc0fa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.623709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0582a4d9-932b-4ff9-93bb-517405b3bb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb0530980a146d19e0b2f68bdc0fa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.647313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1339/2687] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:24 2022] DELETE /identity/v3/users/bdb0530980a146d19e0b2f68bdc0fa53 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:24.847250 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.859965 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cff48-44d7-4a34-98c1-3901c2f9ef4b service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.920199 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.921076 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.921362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.921642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] PATH_INFO: `/v3/projects/c0afd159d9934a588ddda1a864cc9973` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.922926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0afd159d9934a588ddda1a864cc9973)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.924802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.974469 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0afd159d9934a588ddda1a864cc9973', 'request_id': 'req-8c3887cb-c84a-42bd-8644-99766e1a67c4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.980800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0afd159d9934a588ddda1a864cc9973', 'request_id': 'req-8c3887cb-c84a-42bd-8644-99766e1a67c4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.986392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0afd159d9934a588ddda1a864cc9973', 'request_id': 'req-8c3887cb-c84a-42bd-8644-99766e1a67c4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:24.999207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] The token cache is being invalidate because project c0afd159d9934a588ddda1a864cc9973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:24.999499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.000137 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8c3887cb-c84a-42bd-8644-99766e1a67c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.001694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1349/2688] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:24 2022] DELETE /identity/v3/projects/c0afd159d9934a588ddda1a864cc9973 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:25.006816 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5f9e-4713-4df5-8cef-edd886ed68a7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.007110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5f9e-4713-4df5-8cef-edd886ed68a7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.007393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5f9e-4713-4df5-8cef-edd886ed68a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.026338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-072a5f9e-4713-4df5-8cef-edd886ed68a7 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:25.027560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-072a5f9e-4713-4df5-8cef-edd886ed68a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:25.091747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1340/2689] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:25.101103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae03f6-e121-4cfc-9cbb-82c1165762a4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.101403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae03f6-e121-4cfc-9cbb-82c1165762a4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.101687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae03f6-e121-4cfc-9cbb-82c1165762a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.121758 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-73ae03f6-e121-4cfc-9cbb-82c1165762a4 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:25.122892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-73ae03f6-e121-4cfc-9cbb-82c1165762a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:25.131986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1350/2690] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:25.136743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a5f9e-4713-4df5-8cef-edd886ed68a7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.150755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a5f9e-4713-4df5-8cef-edd886ed68a7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.155569 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.156240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.156527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.156807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.157684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:25.158003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.159727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.161324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:25.176867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1341/2691] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:54:25.178530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae03f6-e121-4cfc-9cbb-82c1165762a4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.189800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae03f6-e121-4cfc-9cbb-82c1165762a4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.194867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.195523 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.195811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.196634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.197330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.199611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.228060 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1351/2692] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:25 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:25.229213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.240002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d7139-95fd-441f-b6a0-95118dd41670 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.296408 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.297094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.297375 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.297657 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.298384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.300318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.320917 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1342/2693] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:25 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:54:25.326324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.342038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549a4b0-b49a-4aee-85b1-e529927fb886 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.346790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.347466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.347756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.348040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.348788 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.350685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.361992 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1352/2694] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:25.365894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.376554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb125-7393-453e-aa77-0b5377d87ece admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.381149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b984158-1ac7-49b8-aef1-3530d5e49865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.381806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984158-1ac7-49b8-aef1-3530d5e49865 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.382086 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984158-1ac7-49b8-aef1-3530d5e49865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.382393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984158-1ac7-49b8-aef1-3530d5e49865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.383121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b984158-1ac7-49b8-aef1-3530d5e49865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.384723 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b984158-1ac7-49b8-aef1-3530d5e49865 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.396698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1343/2695] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:25.400737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.411395 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a349b-e3a3-4852-b766-d4b22e515994 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.416696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.417591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.417879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.418164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] PATH_INFO: `/v3/projects/c08aa845eb80494b84c2d5d47d26b5c1/users/cfb761b802044d63a52915d8750ccb3d/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.434483 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08aa845eb80494b84c2d5d47d26b5c1, user_id=cfb761b802044d63a52915d8750ccb3d, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.437157 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.453513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1353/2696] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:25 2022] PUT /identity/v3/projects/c08aa845eb80494b84c2d5d47d26b5c1/users/cfb761b802044d63a52915d8750ccb3d/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:25.458800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38aa10-ae5e-42bc-8f70-4b25013051cd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.459094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38aa10-ae5e-42bc-8f70-4b25013051cd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.459376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38aa10-ae5e-42bc-8f70-4b25013051cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.478221 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-aa38aa10-ae5e-42bc-8f70-4b25013051cd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:25.479511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aa38aa10-ae5e-42bc-8f70-4b25013051cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:25.540646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1344/2697] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:25.555296 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.557674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:25.571908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:25.616449 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920695-94b0-497a-8cd4-29b4da1560c0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.620686 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.621329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.621616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.621894 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.630869 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.632298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.642104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1354/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:26.277926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67697-470b-4eab-9109-59534f6a3a8b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.278245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67697-470b-4eab-9109-59534f6a3a8b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.278524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67697-470b-4eab-9109-59534f6a3a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.305905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-21d67697-470b-4eab-9109-59534f6a3a8b None None] MFA Rules not processed for user `cfb761b802044d63a52915d8750ccb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:26.308440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-21d67697-470b-4eab-9109-59534f6a3a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:26.378511 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1345/2699] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:26.383156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:26.394008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e9db-979b-48f8-943a-c594264b8db8 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:26.398769 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:26.399507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.399792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.400069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.400784 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:26.402803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:26.432478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1355/2700] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:26 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:54:26.433977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d67697-470b-4eab-9109-59534f6a3a8b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:26.440441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:26.448099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d67697-470b-4eab-9109-59534f6a3a8b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:26.507261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:26.507943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.508224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.509140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.509837 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:26.511779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:26.534078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1346/2701] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:26 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:26.538107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:26.549096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d02c-dfe5-48ee-9525-fe180b34a925 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:26.553775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:26.554480 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.554771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.555128 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.556387 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:26.557982 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:26.568609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1356/2702] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:26.573331 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:26.583802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd6e4-6b1d-49dd-ab48-e91f886ca778 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:26.588467 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:26.589349 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.589634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.589910 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] PATH_INFO: `/v3/projects/40f0c1151819486aa5d29aafdd8e0d95/users/cd407f012c404fccb2e96d16e60c8608/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.605432 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f0c1151819486aa5d29aafdd8e0d95, user_id=cd407f012c404fccb2e96d16e60c8608, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:26.608134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:26.621058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1347/2703] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:26 2022] PUT /identity/v3/projects/40f0c1151819486aa5d29aafdd8e0d95/users/cd407f012c404fccb2e96d16e60c8608/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:26.625177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:26.636176 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c678fca-ed8c-42ca-a18c-1a7873004dc0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:26.693017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1317-db56-4782-9f34-b4bbbf0d66a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:26.693581 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1317-db56-4782-9f34-b4bbbf0d66a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.693867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1317-db56-4782-9f34-b4bbbf0d66a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.694143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1317-db56-4782-9f34-b4bbbf0d66a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.694911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1317-db56-4782-9f34-b4bbbf0d66a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:26.697109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1317-db56-4782-9f34-b4bbbf0d66a6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:26.706729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1357/2704] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:26.711098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:26.721322 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b8e87-270f-40c5-8702-3e2d601f3123 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:26.726153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:26.727072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.727339 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.727647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] PATH_INFO: `/v3/projects/40f0c1151819486aa5d29aafdd8e0d95/users/cd407f012c404fccb2e96d16e60c8608/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.729618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f0c1151819486aa5d29aafdd8e0d95, user_id=cd407f012c404fccb2e96d16e60c8608, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:26.732282 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:26.742679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1348/2705] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:26 2022] PUT /identity/v3/projects/40f0c1151819486aa5d29aafdd8e0d95/users/cd407f012c404fccb2e96d16e60c8608/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:27.363796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bb06-22ac-48bd-ab35-e0c457b3a26a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.364085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bb06-22ac-48bd-ab35-e0c457b3a26a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.364363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bb06-22ac-48bd-ab35-e0c457b3a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.391040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c6a4bb06-22ac-48bd-ab35-e0c457b3a26a None None] MFA Rules not processed for user `cd407f012c404fccb2e96d16e60c8608`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:27.392385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c6a4bb06-22ac-48bd-ab35-e0c457b3a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:27.465333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1358/2706] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:28.478880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.480808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:28.537167 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4bb06-22ac-48bd-ab35-e0c457b3a26a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.544958 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:28.569746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9155028-f614-4bde-824a-87c5baecd64d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.576220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.576938 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.577225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.577505 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.579344 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:28.592154 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.593796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.606099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1349/2707] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:28.610135 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4bb06-22ac-48bd-ab35-e0c457b3a26a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.614892 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.615780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.616069 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.616351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] PATH_INFO: `/v3/users/cfb761b802044d63a52915d8750ccb3d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.617763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb761b802044d63a52915d8750ccb3d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.620267 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.669705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb761b802044d63a52915d8750ccb3d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:28.681642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb761b802044d63a52915d8750ccb3d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:28.690030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb761b802044d63a52915d8750ccb3d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:28.699803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb761b802044d63a52915d8750ccb3d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:28.700512 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb761b802044d63a52915d8750ccb3d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:28.707026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1359/2708] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:28 2022] DELETE /identity/v3/users/cfb761b802044d63a52915d8750ccb3d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:28.885743 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.897469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e88adf-d82f-48b7-a9a0-d9b97e5fe6cd service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.943820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:28.959760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.960626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.960908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.961211 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] PATH_INFO: `/v3/projects/c08aa845eb80494b84c2d5d47d26b5c1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.962906 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08aa845eb80494b84c2d5d47d26b5c1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.964807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.012612 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08aa845eb80494b84c2d5d47d26b5c1', 'request_id': 'req-599f5903-a0b4-437f-8b8d-55938cd9d5cd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.023110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08aa845eb80494b84c2d5d47d26b5c1', 'request_id': 'req-599f5903-a0b4-437f-8b8d-55938cd9d5cd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.029469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08aa845eb80494b84c2d5d47d26b5c1', 'request_id': 'req-599f5903-a0b4-437f-8b8d-55938cd9d5cd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.040842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] The token cache is being invalidate because project c08aa845eb80494b84c2d5d47d26b5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:29.041131 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.041790 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.043386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1350/2709] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:28 2022] DELETE /identity/v3/projects/c08aa845eb80494b84c2d5d47d26b5c1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:29.047430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.048860 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:29.063467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032c97d-bbbf-479b-b74b-7123a77bb707 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.126752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.127641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.127925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.128203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] PATH_INFO: `/v3/users/cd407f012c404fccb2e96d16e60c8608` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.129431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd407f012c404fccb2e96d16e60c8608)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.131430 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.161327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:29.181194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd407f012c404fccb2e96d16e60c8608'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.192871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd407f012c404fccb2e96d16e60c8608'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.200950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd407f012c404fccb2e96d16e60c8608'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.209344 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd407f012c404fccb2e96d16e60c8608'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.210084 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-726e0587-e884-4e81-913b-906556aa611b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd407f012c404fccb2e96d16e60c8608'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.216940 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1360/2710] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:29 2022] DELETE /identity/v3/users/cd407f012c404fccb2e96d16e60c8608 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:29.397122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.399036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:29.412250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5903-a0b4-437f-8b8d-55938cd9d5cd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.470846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.471729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.472011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.472285 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] PATH_INFO: `/v3/projects/40f0c1151819486aa5d29aafdd8e0d95` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.473500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f0c1151819486aa5d29aafdd8e0d95)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.475702 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.523674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f0c1151819486aa5d29aafdd8e0d95', 'request_id': 'req-417547b9-aace-435c-9054-ce9bc099e585'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.531392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f0c1151819486aa5d29aafdd8e0d95', 'request_id': 'req-417547b9-aace-435c-9054-ce9bc099e585'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.537225 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f0c1151819486aa5d29aafdd8e0d95', 'request_id': 'req-417547b9-aace-435c-9054-ce9bc099e585'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.548376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] The token cache is being invalidate because project 40f0c1151819486aa5d29aafdd8e0d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:29.548668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.549311 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-417547b9-aace-435c-9054-ce9bc099e585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:29.550887 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1351/2711] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:29 2022] DELETE /identity/v3/projects/40f0c1151819486aa5d29aafdd8e0d95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:29.557253 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b90d6-3730-4cf6-9564-c0b90cf22c50 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.557732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b90d6-3730-4cf6-9564-c0b90cf22c50 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.557835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b90d6-3730-4cf6-9564-c0b90cf22c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.577304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-693b90d6-3730-4cf6-9564-c0b90cf22c50 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:29.578747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-693b90d6-3730-4cf6-9564-c0b90cf22c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:29.639260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1361/2712] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:29.647926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f173-677b-4f84-8df3-d0aacc26602d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.648157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f173-677b-4f84-8df3-d0aacc26602d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.648437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f173-677b-4f84-8df3-d0aacc26602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.656035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:29.667888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2313f173-677b-4f84-8df3-d0aacc26602d None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:29.669582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2313f173-677b-4f84-8df3-d0aacc26602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:29.677831 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1352/2713] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:29.682734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b90d6-3730-4cf6-9564-c0b90cf22c50 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.692724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b90d6-3730-4cf6-9564-c0b90cf22c50 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.698331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.698994 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.699279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.699558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.700301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:29.700599 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.702218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.713911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1362/2714] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:54:29.718599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f173-677b-4f84-8df3-d0aacc26602d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.728303 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f173-677b-4f84-8df3-d0aacc26602d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.733094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.733757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.734068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.734385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.735134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.737106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.769868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1353/2715] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:29 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:29.771099 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.781356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfae5c9-451e-4cac-8297-87239840183b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.841908 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.842625 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.842916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.843201 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.843906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.845859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.866440 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1363/2716] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:29 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:29.870945 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.881199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7aad2-b89e-42ad-b34e-cd6ed0075d82 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.885761 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.886449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.886733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.887009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.887767 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.889376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.900182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1354/2717] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:29.904062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.914088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f890a8-3b52-4520-bbd3-e0aecbb613da admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.919294 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c63e3d-1e2c-4055-81f6-44733399d864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.919959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63e3d-1e2c-4055-81f6-44733399d864 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.920247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63e3d-1e2c-4055-81f6-44733399d864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.920529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63e3d-1e2c-4055-81f6-44733399d864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.921271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c63e3d-1e2c-4055-81f6-44733399d864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.922915 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c63e3d-1e2c-4055-81f6-44733399d864 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.934309 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1364/2718] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:29.938433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.948691 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370a44a-ac35-45fe-b6da-f7a79424c8c7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.953391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.954307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.954590 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.954862 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] PATH_INFO: `/v3/projects/e6c6b8e3c3b248b788042f9028d7d9a2/users/e41a41dbb98445b394e1804e4dce0f68/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.970490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c6b8e3c3b248b788042f9028d7d9a2, user_id=e41a41dbb98445b394e1804e4dce0f68, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.973140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.987823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1355/2719] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:29 2022] PUT /identity/v3/projects/e6c6b8e3c3b248b788042f9028d7d9a2/users/e41a41dbb98445b394e1804e4dce0f68/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:29.998771 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf691-8c16-456f-a734-e392e0701b18 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.999065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf691-8c16-456f-a734-e392e0701b18 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.999349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf691-8c16-456f-a734-e392e0701b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.017220 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:30.027519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-13fcf691-8c16-456f-a734-e392e0701b18 None None] MFA Rules not processed for user `e41a41dbb98445b394e1804e4dce0f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:30.028987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-13fcf691-8c16-456f-a734-e392e0701b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:30.095974 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1365/2720] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:30.100850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.172194 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84acb4-c10c-4809-b06e-aa58852fa0a7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.179291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.180396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.180558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.181110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.184624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.189987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.217879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1356/2721] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:30 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:30.227826 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcf691-8c16-456f-a734-e392e0701b18 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.240384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcf691-8c16-456f-a734-e392e0701b18 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.303208 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.303927 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.304290 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.304569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.305270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.307371 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.330476 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1366/2722] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:30 2022] POST /identity/v3/users => generated 307 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:30.334662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.345840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c49d6-0d3c-4fb1-8857-da2bb3803afb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.351148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.351828 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.352727 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.353007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.353744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.355453 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.367774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1357/2723] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:30.372040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.382739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829536-fe1e-4174-8400-1c7f5327f3bb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.387505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.388406 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.388688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.388963 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] PATH_INFO: `/v3/projects/b631bfa4e6ee4ca8ac836204f21a251b/users/2f34ac7bb1e44199a2d73dffc30eeab1/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.408279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b631bfa4e6ee4ca8ac836204f21a251b, user_id=2f34ac7bb1e44199a2d73dffc30eeab1, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.408279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.422794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1367/2724] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:30 2022] PUT /identity/v3/projects/b631bfa4e6ee4ca8ac836204f21a251b/users/2f34ac7bb1e44199a2d73dffc30eeab1/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:30.426944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.438318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9022-910e-412a-98ac-1c55765ee2ac admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.526954 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a17d3-e6b6-47bc-b8a1-725d8d3e007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.528567 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a17d3-e6b6-47bc-b8a1-725d8d3e007b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.528850 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a17d3-e6b6-47bc-b8a1-725d8d3e007b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.529123 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a17d3-e6b6-47bc-b8a1-725d8d3e007b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.529864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a17d3-e6b6-47bc-b8a1-725d8d3e007b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.532320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a17d3-e6b6-47bc-b8a1-725d8d3e007b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.544409 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1358/2725] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:30.548637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.559222 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859b85-c20f-431c-a9dd-22223873340d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.565213 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.566110 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.566420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.566699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] PATH_INFO: `/v3/projects/b631bfa4e6ee4ca8ac836204f21a251b/users/2f34ac7bb1e44199a2d73dffc30eeab1/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.568699 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b631bfa4e6ee4ca8ac836204f21a251b, user_id=2f34ac7bb1e44199a2d73dffc30eeab1, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.571883 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.583573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1368/2726] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:30 2022] PUT /identity/v3/projects/b631bfa4e6ee4ca8ac836204f21a251b/users/2f34ac7bb1e44199a2d73dffc30eeab1/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:30.595876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d683-3e53-4789-8c85-c11c25cabac9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.596237 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d683-3e53-4789-8c85-c11c25cabac9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.596433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d683-3e53-4789-8c85-c11c25cabac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.615993 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:30.624520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4cd3d683-3e53-4789-8c85-c11c25cabac9 None None] MFA Rules not processed for user `2f34ac7bb1e44199a2d73dffc30eeab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:30.626800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4cd3d683-3e53-4789-8c85-c11c25cabac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:30.699427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1359/2727] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:30.709770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.712168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:30.770675 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ab905-b698-4161-b1a0-13a495fc8eba admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.774359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.775043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.775952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.776233 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.782538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:30.787312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.788896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.800022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1369/2728] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:30.875215 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3d683-3e53-4789-8c85-c11c25cabac9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:30.885856 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3d683-3e53-4789-8c85-c11c25cabac9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:30.889759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037894f1-772e-4224-bc31-27ef94770ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:30.890441 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037894f1-772e-4224-bc31-27ef94770ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:30.890718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037894f1-772e-4224-bc31-27ef94770ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:30.890995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037894f1-772e-4224-bc31-27ef94770ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:30.953627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037894f1-772e-4224-bc31-27ef94770ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:30.955020 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037894f1-772e-4224-bc31-27ef94770ca2 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:30.964158 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1360/2729] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:35.035862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:35.100873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c625a2-1f6e-4312-a5b3-120e3a5f6c29 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:35.106161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:35.107054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.107337 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.107778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] PATH_INFO: `/v3/users/e41a41dbb98445b394e1804e4dce0f68` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.109080 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41a41dbb98445b394e1804e4dce0f68)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:35.111104 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:35.160432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41a41dbb98445b394e1804e4dce0f68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.174045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41a41dbb98445b394e1804e4dce0f68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.181066 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41a41dbb98445b394e1804e4dce0f68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.191711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41a41dbb98445b394e1804e4dce0f68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.192573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41a41dbb98445b394e1804e4dce0f68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.198757 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1370/2730] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:35 2022] DELETE /identity/v3/users/e41a41dbb98445b394e1804e4dce0f68 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:35.203791 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.204357 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.204926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.222626 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:35.223834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:35.284095 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1361/2731] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:35.294980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:35.296445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:35.360098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e865f-8c75-4f9c-b536-b2c2ff949b9b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:35.364530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:35.365251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.365652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.365979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.379897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:35.381320 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:35.391291 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1371/2732] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:35.674203 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:35.675678 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:35.691662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d514-e42c-484d-94d3-de1e929a43d5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:35.698024 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:35.699002 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.699321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.699715 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] PATH_INFO: `/v3/projects/e6c6b8e3c3b248b788042f9028d7d9a2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.700931 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c6b8e3c3b248b788042f9028d7d9a2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:35.703179 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:35.743373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:35.760000 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c6b8e3c3b248b788042f9028d7d9a2', 'request_id': 'req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.768499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c6b8e3c3b248b788042f9028d7d9a2', 'request_id': 'req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.774340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c6b8e3c3b248b788042f9028d7d9a2', 'request_id': 'req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.786768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] The token cache is being invalidate because project e6c6b8e3c3b248b788042f9028d7d9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:35.787047 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.787748 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.789666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1362/2733] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:35 2022] DELETE /identity/v3/projects/e6c6b8e3c3b248b788042f9028d7d9a2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:35.793601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:35.803556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c7f3-f9ee-4990-8a6c-28377fe2e7d0 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:35.815382 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:35.869349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:35.870258 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.870552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.870835 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] PATH_INFO: `/v3/users/2f34ac7bb1e44199a2d73dffc30eeab1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.872107 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f34ac7bb1e44199a2d73dffc30eeab1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:35.874065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:35.923639 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f34ac7bb1e44199a2d73dffc30eeab1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.938865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f34ac7bb1e44199a2d73dffc30eeab1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.946550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f34ac7bb1e44199a2d73dffc30eeab1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.954882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f34ac7bb1e44199a2d73dffc30eeab1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.955558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41457724-2602-487b-b2eb-360f2bffb3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f34ac7bb1e44199a2d73dffc30eeab1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.962017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1372/2734] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:35 2022] DELETE /identity/v3/users/2f34ac7bb1e44199a2d73dffc30eeab1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:36.237770 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.239277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.252836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5e7a1-a9b2-4dbb-879f-5c33d663f1df admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.310704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.311582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.312034 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.312318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] PATH_INFO: `/v3/projects/b631bfa4e6ee4ca8ac836204f21a251b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.313522 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b631bfa4e6ee4ca8ac836204f21a251b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.315492 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.362402 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b631bfa4e6ee4ca8ac836204f21a251b', 'request_id': 'req-ed76b592-cfbe-4baf-ade8-d6f17f007358'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.369886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b631bfa4e6ee4ca8ac836204f21a251b', 'request_id': 'req-ed76b592-cfbe-4baf-ade8-d6f17f007358'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.375329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b631bfa4e6ee4ca8ac836204f21a251b', 'request_id': 'req-ed76b592-cfbe-4baf-ade8-d6f17f007358'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.386709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] The token cache is being invalidate because project b631bfa4e6ee4ca8ac836204f21a251b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:36.386994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.387624 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed76b592-cfbe-4baf-ade8-d6f17f007358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.389155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1363/2735] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:36 2022] DELETE /identity/v3/projects/b631bfa4e6ee4ca8ac836204f21a251b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:36.394109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52867-cfa1-4b2e-8a67-bd6c5e60401b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.394640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52867-cfa1-4b2e-8a67-bd6c5e60401b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.394825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52867-cfa1-4b2e-8a67-bd6c5e60401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.413305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dff52867-cfa1-4b2e-8a67-bd6c5e60401b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:36.414575 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dff52867-cfa1-4b2e-8a67-bd6c5e60401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.478720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1373/2736] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:36.482549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a5ff8-1cc4-4e9d-b32a-6832bdc387df None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.482769 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a5ff8-1cc4-4e9d-b32a-6832bdc387df None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.482937 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a5ff8-1cc4-4e9d-b32a-6832bdc387df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.506368 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8a4a5ff8-1cc4-4e9d-b32a-6832bdc387df None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:36.507591 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8a4a5ff8-1cc4-4e9d-b32a-6832bdc387df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.515919 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1364/2737] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:36.520037 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff52867-cfa1-4b2e-8a67-bd6c5e60401b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.530921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff52867-cfa1-4b2e-8a67-bd6c5e60401b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.536355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.537042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.537331 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.537611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.538551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:36.538868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.540558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.553001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1374/2738] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:54:36.557908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a5ff8-1cc4-4e9d-b32a-6832bdc387df None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.567184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a5ff8-1cc4-4e9d-b32a-6832bdc387df None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.571939 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.572595 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.572882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.573162 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.573860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.575840 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.602061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1365/2739] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:54:36.607174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.617420 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af8b10-fa1c-4974-b579-3e5e8d348c1f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.636306 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:36.678384 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.679061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.679355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.679635 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.680330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.682987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.703641 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1375/2740] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:54:36.707803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.718163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be95aa-25ac-4e75-9987-d2d9800ffdbe admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.722738 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.723345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.723625 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.723897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.724653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.726531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.738535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1366/2741] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:36.742388 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.752980 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c0a91-2af7-4fab-b65f-9923e457c9a4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.757866 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577eb07-fbcb-4dd0-adba-c822c26813e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.758569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577eb07-fbcb-4dd0-adba-c822c26813e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.758855 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577eb07-fbcb-4dd0-adba-c822c26813e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.759133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577eb07-fbcb-4dd0-adba-c822c26813e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.759867 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577eb07-fbcb-4dd0-adba-c822c26813e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.761474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577eb07-fbcb-4dd0-adba-c822c26813e8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.771999 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1376/2742] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:36.775826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.785829 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8074f69-b2df-4bae-8356-e6bbf76282e2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.790550 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.791912 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.792196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.792470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] PATH_INFO: `/v3/projects/7405efd0553d427e933fab3e5e8844f2/users/63046b99b7954b6398caff414e6cd08e/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.795565 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:36.809781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7405efd0553d427e933fab3e5e8844f2, user_id=63046b99b7954b6398caff414e6cd08e, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.812446 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.824658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1367/2743] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:36 2022] PUT /identity/v3/projects/7405efd0553d427e933fab3e5e8844f2/users/63046b99b7954b6398caff414e6cd08e/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:36.836211 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5947c-d609-45af-86eb-4b270736ae19 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.836511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5947c-d609-45af-86eb-4b270736ae19 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.836857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5947c-d609-45af-86eb-4b270736ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.866551 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-92a5947c-d609-45af-86eb-4b270736ae19 None None] MFA Rules not processed for user `63046b99b7954b6398caff414e6cd08e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:36.867798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-92a5947c-d609-45af-86eb-4b270736ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.936156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1377/2744] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:36.940800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.004940 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102dfcf-af3d-4bb4-9818-1c0f6afcaabf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.010079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.010774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.011058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.011436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.012247 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.014277 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.044039 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1368/2745] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:54:37.047931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5947c-d609-45af-86eb-4b270736ae19 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.058777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5947c-d609-45af-86eb-4b270736ae19 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.117688 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.118405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.118692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.118993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.119711 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.121622 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.141432 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1378/2746] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:37 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:37.145493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.156621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f969dca-ea24-442b-a6e2-2d1d1ce3527c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.161379 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.162062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.162395 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.162793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.163419 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.165044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.176905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1369/2747] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:37.181096 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.191333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114366e-43c2-4182-810c-4f1d632c2940 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.195998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.196886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.197672 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.197952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] PATH_INFO: `/v3/projects/ac98e90378ef45c2a0b3acb9fa006dd5/users/53e16494447546a0ba8604ab67e3e5da/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.213723 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac98e90378ef45c2a0b3acb9fa006dd5, user_id=53e16494447546a0ba8604ab67e3e5da, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.216614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.219917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:37.231126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1379/2748] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:37 2022] PUT /identity/v3/projects/ac98e90378ef45c2a0b3acb9fa006dd5/users/53e16494447546a0ba8604ab67e3e5da/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:37.235261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.245521 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ab094-d094-4caf-a91a-43ad91c24550 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.301011 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15a344-83d7-4629-8433-296587174c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.301685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15a344-83d7-4629-8433-296587174c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.301970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15a344-83d7-4629-8433-296587174c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.302296 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15a344-83d7-4629-8433-296587174c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.303032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15a344-83d7-4629-8433-296587174c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.304630 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15a344-83d7-4629-8433-296587174c79 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.314752 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1370/2749] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:54:37.319031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.330120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d369d07-cb61-4d28-93e6-b107ab59a2be admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.334763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.335674 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.335955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.336231 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] PATH_INFO: `/v3/projects/ac98e90378ef45c2a0b3acb9fa006dd5/users/53e16494447546a0ba8604ab67e3e5da/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.338793 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac98e90378ef45c2a0b3acb9fa006dd5, user_id=53e16494447546a0ba8604ab67e3e5da, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.341379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.351932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1380/2750] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:37 2022] PUT /identity/v3/projects/ac98e90378ef45c2a0b3acb9fa006dd5/users/53e16494447546a0ba8604ab67e3e5da/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:37.365819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770841bf-cc43-4073-a0ca-8f83c7283e3b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.366087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770841bf-cc43-4073-a0ca-8f83c7283e3b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.366396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770841bf-cc43-4073-a0ca-8f83c7283e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.393049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-770841bf-cc43-4073-a0ca-8f83c7283e3b None None] MFA Rules not processed for user `53e16494447546a0ba8604ab67e3e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:37.394297 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-770841bf-cc43-4073-a0ca-8f83c7283e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:37.437009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:37.463788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1371/2751] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:37.475589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.477345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:37.536261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43a2e-d259-4b59-8967-e6069447f431 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.539996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.540648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.540935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.541214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.552094 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.553587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.563951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1381/2752] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:37.645621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770841bf-cc43-4073-a0ca-8f83c7283e3b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.655335 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770841bf-cc43-4073-a0ca-8f83c7283e3b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.659254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539e527-4a34-484e-ba3c-018fe2b5ee12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.659918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539e527-4a34-484e-ba3c-018fe2b5ee12 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.660205 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539e527-4a34-484e-ba3c-018fe2b5ee12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.660487 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539e527-4a34-484e-ba3c-018fe2b5ee12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.718598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539e527-4a34-484e-ba3c-018fe2b5ee12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.720046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539e527-4a34-484e-ba3c-018fe2b5ee12 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.729230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1372/2753] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:42.402735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:42.464708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be04d8-a6fc-42a5-8c08-f312836e3427 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:42.470024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:42.471013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:42.471240 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:42.471496 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] PATH_INFO: `/v3/users/63046b99b7954b6398caff414e6cd08e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:42.472722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63046b99b7954b6398caff414e6cd08e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:42.474687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:42.523837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63046b99b7954b6398caff414e6cd08e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:42.535949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63046b99b7954b6398caff414e6cd08e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:42.543272 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63046b99b7954b6398caff414e6cd08e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:42.551336 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63046b99b7954b6398caff414e6cd08e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:42.551985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63046b99b7954b6398caff414e6cd08e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:42.558724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1382/2754] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:42 2022] DELETE /identity/v3/users/63046b99b7954b6398caff414e6cd08e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:42.563823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e452-456b-4673-ad79-73dc970a991b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:42.564347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e452-456b-4673-ad79-73dc970a991b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:42.564442 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e452-456b-4673-ad79-73dc970a991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:42.581508 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6172e452-456b-4673-ad79-73dc970a991b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:42.582739 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6172e452-456b-4673-ad79-73dc970a991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:42.644604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1373/2755] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:42.654624 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:42.656169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:42.663014 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:42.717961 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864625-e17e-4b40-89eb-dc66a7d92c48 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:42.721936 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:42.722638 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:42.722926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:42.723207 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:42.733415 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:42.734884 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:42.745061 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1383/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:43.035608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e452-456b-4673-ad79-73dc970a991b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:43.037230 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6172e452-456b-4673-ad79-73dc970a991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:43.051701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e452-456b-4673-ad79-73dc970a991b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:43.057084 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:43.057964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:43.058278 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:43.058554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] PATH_INFO: `/v3/projects/7405efd0553d427e933fab3e5e8844f2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:43.059826 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7405efd0553d427e933fab3e5e8844f2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:43.061866 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:43.109744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7405efd0553d427e933fab3e5e8844f2', 'request_id': 'req-ba93d4bf-c016-42cb-ac05-10687f44b97d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.117914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7405efd0553d427e933fab3e5e8844f2', 'request_id': 'req-ba93d4bf-c016-42cb-ac05-10687f44b97d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.124725 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7405efd0553d427e933fab3e5e8844f2', 'request_id': 'req-ba93d4bf-c016-42cb-ac05-10687f44b97d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.136347 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] The token cache is being invalidate because project 7405efd0553d427e933fab3e5e8844f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:43.136635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.137290 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.138877 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1374/2757] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:43 2022] DELETE /identity/v3/projects/7405efd0553d427e933fab3e5e8844f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:43.143030 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:43.153413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f8ac4-91ff-41d1-8d3a-53b8250f96f5 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:43.214786 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:43.215736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:43.216058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:43.216251 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] PATH_INFO: `/v3/users/53e16494447546a0ba8604ab67e3e5da` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:43.217559 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e16494447546a0ba8604ab67e3e5da)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:43.219516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:43.267068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e16494447546a0ba8604ab67e3e5da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.279528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e16494447546a0ba8604ab67e3e5da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.286586 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e16494447546a0ba8604ab67e3e5da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.295266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e16494447546a0ba8604ab67e3e5da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.295998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72032ac-bf80-42eb-baa6-b504daa06b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e16494447546a0ba8604ab67e3e5da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.304120 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1384/2758] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:43 2022] DELETE /identity/v3/users/53e16494447546a0ba8604ab67e3e5da => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:43.583500 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:43.585354 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:43.596687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:43.608421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d4bf-c016-42cb-ac05-10687f44b97d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:43.674526 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:43.675418 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:43.675696 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:43.675967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] PATH_INFO: `/v3/projects/ac98e90378ef45c2a0b3acb9fa006dd5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:43.677325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac98e90378ef45c2a0b3acb9fa006dd5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:43.679292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:43.729708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac98e90378ef45c2a0b3acb9fa006dd5', 'request_id': 'req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.738152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac98e90378ef45c2a0b3acb9fa006dd5', 'request_id': 'req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.744501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac98e90378ef45c2a0b3acb9fa006dd5', 'request_id': 'req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.755936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] The token cache is being invalidate because project ac98e90378ef45c2a0b3acb9fa006dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:43.756218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.756883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dab4247-e4f8-42ca-83c2-00ddbd9cde43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:43.758530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1375/2759] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:43 2022] DELETE /identity/v3/projects/ac98e90378ef45c2a0b3acb9fa006dd5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:43.765696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a8962-29bd-4b1d-8a7a-de7b7622dad9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:43.766241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a8962-29bd-4b1d-8a7a-de7b7622dad9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:43.766343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a8962-29bd-4b1d-8a7a-de7b7622dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:43.784463 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-010a8962-29bd-4b1d-8a7a-de7b7622dad9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:43.785683 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-010a8962-29bd-4b1d-8a7a-de7b7622dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:43.806059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:43.847328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1385/2760] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:43.855823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ef1a-bfc1-4955-afe5-2187cbf6a311 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:43.855823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ef1a-bfc1-4955-afe5-2187cbf6a311 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:43.856105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ef1a-bfc1-4955-afe5-2187cbf6a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:43.876574 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f148ef1a-bfc1-4955-afe5-2187cbf6a311 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:43.877787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f148ef1a-bfc1-4955-afe5-2187cbf6a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:43.887333 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1376/2761] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:43.891687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a8962-29bd-4b1d-8a7a-de7b7622dad9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:43.903138 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a8962-29bd-4b1d-8a7a-de7b7622dad9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:43.908238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:43.908926 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:43.909218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:43.909505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:43.910302 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:43.910654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:43.913569 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:43.927405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1386/2762] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:54:43.932245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ef1a-bfc1-4955-afe5-2187cbf6a311 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:43.941428 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ef1a-bfc1-4955-afe5-2187cbf6a311 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:43.947836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:43.948520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:43.948765 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:43.949082 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:43.949965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:43.951898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:43.986035 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1377/2763] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:43 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:43.990424 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.001142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e087f-463a-4bcc-b552-fc46e83adec6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.059343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.060016 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.060299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.060579 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.061279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.063238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.082816 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1387/2764] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:43 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:44.087547 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.097894 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa245ac6-12f4-4f73-80b9-cc1ef27c3d99 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.102670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.103928 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.104209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.104479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.105204 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.106847 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.117269 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1378/2765] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:44.122047 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.133190 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd279e-b1fb-48ca-ae3f-910d7cf0519c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.138103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa37e7f-2019-451d-bb89-8ff54a6913fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.138832 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa37e7f-2019-451d-bb89-8ff54a6913fd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.139141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa37e7f-2019-451d-bb89-8ff54a6913fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.139419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa37e7f-2019-451d-bb89-8ff54a6913fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.140241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa37e7f-2019-451d-bb89-8ff54a6913fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.141875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa37e7f-2019-451d-bb89-8ff54a6913fd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.152130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1388/2766] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:44.156301 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.167581 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a705b-b808-463b-9613-a958147d4f95 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.172276 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.173149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.173434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.173703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] PATH_INFO: `/v3/projects/491b8d5c282d4747a21b59fc767902d7/users/eab64cd2e6164894b7c8206ed02daa53/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.188863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491b8d5c282d4747a21b59fc767902d7, user_id=eab64cd2e6164894b7c8206ed02daa53, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.191540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.205073 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1379/2767] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:44 2022] PUT /identity/v3/projects/491b8d5c282d4747a21b59fc767902d7/users/eab64cd2e6164894b7c8206ed02daa53/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:44.216416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.216705 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.216996 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.368397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] MFA Rules not processed for user `eab64cd2e6164894b7c8206ed02daa53`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:44.369592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:44.432577 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1389/2768] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:44.443175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.444896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:44.479431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:44.507507 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a5210-6eab-42cd-8745-33889d79c659 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.512830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.513493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.513780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.514056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.523087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.524557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.533618 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1380/2769] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:50.219970 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:50.221529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:50.254304 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:50.283009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42d830-73a8-4780-800f-019bd4876c10 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:50.286766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a93d-f8e1-47e1-bccc-d48b28a840c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:50.287425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a93d-f8e1-47e1-bccc-d48b28a840c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:50.287706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a93d-f8e1-47e1-bccc-d48b28a840c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:50.287978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a93d-f8e1-47e1-bccc-d48b28a840c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:50.289792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d165a93d-f8e1-47e1-bccc-d48b28a840c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:50.369930 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165a93d-f8e1-47e1-bccc-d48b28a840c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:50.371479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165a93d-f8e1-47e1-bccc-d48b28a840c7 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:50.381429 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1390/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:54.529437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=13 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:54.642886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:54.707952 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858c793-7a50-43b2-ae92-0662abf18bc5 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:54.712652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:54.713554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:54.713843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:54.714150 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] PATH_INFO: `/v3/users/eab64cd2e6164894b7c8206ed02daa53` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:54.715385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab64cd2e6164894b7c8206ed02daa53)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:54.717343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:54.764972 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab64cd2e6164894b7c8206ed02daa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:54.765632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab64cd2e6164894b7c8206ed02daa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:54.772456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab64cd2e6164894b7c8206ed02daa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:54.773104 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab64cd2e6164894b7c8206ed02daa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:54.780998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab64cd2e6164894b7c8206ed02daa53'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:54.800170 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1381/2771] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:54 2022] DELETE /identity/v3/users/eab64cd2e6164894b7c8206ed02daa53 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:54.804825 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:54.805310 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:54.805402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:54.823182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:54.824404 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:54.883709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1391/2772] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:54.893577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:54.895009 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:54.951059 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ee01a-c068-456a-a125-276e96cf24d5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:54.954719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:54.955376 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:54.955658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:54.955934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:54.967615 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:54.969955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:54.982920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1382/2773] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:55.251356 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:55.252795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:55.265332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bfd80-1e8f-4586-9488-369d58e820a5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:55.269902 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:55.270802 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:55.271086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:55.271359 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] PATH_INFO: `/v3/projects/491b8d5c282d4747a21b59fc767902d7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:55.272568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491b8d5c282d4747a21b59fc767902d7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:55.274524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:55.319811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491b8d5c282d4747a21b59fc767902d7', 'request_id': 'req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:55.327032 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491b8d5c282d4747a21b59fc767902d7', 'request_id': 'req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:55.333458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491b8d5c282d4747a21b59fc767902d7', 'request_id': 'req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:55.337845 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:55.348778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] The token cache is being invalidate because project 491b8d5c282d4747a21b59fc767902d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:55.349068 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:55.349680 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:55.351495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1392/2774] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:55 2022] DELETE /identity/v3/projects/491b8d5c282d4747a21b59fc767902d7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:55:04.976455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:05.347954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:41.469792 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:41.471305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:41.504664 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f29c4-771a-496c-bf02-f66e0cc70447 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:41.551863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:41.552515 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:41.552804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:41.553077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:41.554871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:41.637835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:41.639944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:41.658611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1383/2775] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:44.818434 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:44.820024 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:44.856670 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d8be0-fa32-4e79-b98e-13bcfd3d4a34 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:44.861179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:44.862048 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:44.862372 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:44.862646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] PATH_INFO: `/v3/users/b3e73f3002da4da3b94cb17f837defb8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:44.863820 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e73f3002da4da3b94cb17f837defb8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:44.865709 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:44.911169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e73f3002da4da3b94cb17f837defb8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:44.923352 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e73f3002da4da3b94cb17f837defb8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:44.930126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e73f3002da4da3b94cb17f837defb8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:44.938009 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e73f3002da4da3b94cb17f837defb8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:44.938613 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58cc9cd8-657a-4620-985c-3adf8e6c8b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e73f3002da4da3b94cb17f837defb8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:44.944614 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1393/2776] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:57:44 2022] DELETE /identity/v3/users/b3e73f3002da4da3b94cb17f837defb8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:45.123483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.133941 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b7bf4-85d9-46c1-a540-aa96c9a9d88e service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.200062 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.201005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.201291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.201568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] PATH_INFO: `/v3/projects/03452ef988ef4428bdcaa554b7bd4700` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.202808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=03452ef988ef4428bdcaa554b7bd4700)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.204737 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.207216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:45.264032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03452ef988ef4428bdcaa554b7bd4700', 'request_id': 'req-257ad0d1-7685-4b24-8280-e811e767bebb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:45.271421 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03452ef988ef4428bdcaa554b7bd4700', 'request_id': 'req-257ad0d1-7685-4b24-8280-e811e767bebb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:45.277161 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03452ef988ef4428bdcaa554b7bd4700', 'request_id': 'req-257ad0d1-7685-4b24-8280-e811e767bebb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:45.288085 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] The token cache is being invalidate because project 03452ef988ef4428bdcaa554b7bd4700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:57:45.288371 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:45.288999 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-257ad0d1-7685-4b24-8280-e811e767bebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:45.290587 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1384/2777] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:57:45 2022] DELETE /identity/v3/projects/03452ef988ef4428bdcaa554b7bd4700 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:45.297617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f78f8-1f21-4dff-a1c6-e230d750ddb3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.298086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f78f8-1f21-4dff-a1c6-e230d750ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.298504 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f78f8-1f21-4dff-a1c6-e230d750ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.317912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-438f78f8-1f21-4dff-a1c6-e230d750ddb3 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:45.319217 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-438f78f8-1f21-4dff-a1c6-e230d750ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:45.388718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1394/2778] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:57:45.396924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17deab-ec51-4087-b6ae-5fedee1d04e0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.397209 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17deab-ec51-4087-b6ae-5fedee1d04e0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.397484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17deab-ec51-4087-b6ae-5fedee1d04e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.417021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5d17deab-ec51-4087-b6ae-5fedee1d04e0 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:45.418242 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5d17deab-ec51-4087-b6ae-5fedee1d04e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:45.427440 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1385/2779] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:45.431747 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f78f8-1f21-4dff-a1c6-e230d750ddb3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.441232 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f78f8-1f21-4dff-a1c6-e230d750ddb3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.445916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.446594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.446876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.447145 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.447863 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:57:45.448163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.449737 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.460910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1395/2780] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:57:45.465134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17deab-ec51-4087-b6ae-5fedee1d04e0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.475114 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17deab-ec51-4087-b6ae-5fedee1d04e0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.479849 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.480772 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.481050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.481323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.482089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.484556 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.519188 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1386/2781] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:45.523500 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.534218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c54a5-abbb-403b-9a03-6e7c93929f35 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.571122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:45.592209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.592879 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.593164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.593442 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.594147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.596058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.616351 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1396/2782] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:57:45 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:45.620423 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.630589 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bea65d-11cc-4fa3-a868-2aeadfea686a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.635199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.635859 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.636153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.636425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.637159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.638796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.650275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1387/2783] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:45.654803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.664729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfb63d-b6ed-44ce-b316-e53ccce08084 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.669529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173fc74-9dba-4031-b6c0-39ef1c00af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.670842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173fc74-9dba-4031-b6c0-39ef1c00af74 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.671125 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173fc74-9dba-4031-b6c0-39ef1c00af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.671403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173fc74-9dba-4031-b6c0-39ef1c00af74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.672132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173fc74-9dba-4031-b6c0-39ef1c00af74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.673718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173fc74-9dba-4031-b6c0-39ef1c00af74 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.683520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1397/2784] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:45.687413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.697226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ccb6-b465-44a8-abbd-8d1230c508ec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.701745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.702639 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.702920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.703196 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] PATH_INFO: `/v3/projects/b54fd58aad814477b5e5e1eb44c5ca70/users/361e9184fad14abb820cad0fd93f9323/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.718992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54fd58aad814477b5e5e1eb44c5ca70, user_id=361e9184fad14abb820cad0fd93f9323, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.721635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.736735 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1388/2785] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:45 2022] PUT /identity/v3/projects/b54fd58aad814477b5e5e1eb44c5ca70/users/361e9184fad14abb820cad0fd93f9323/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:45.747181 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d2bb-062b-43cd-a9a6-308ca75d1770 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.747468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d2bb-062b-43cd-a9a6-308ca75d1770 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.747796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d2bb-062b-43cd-a9a6-308ca75d1770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.775952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9408d2bb-062b-43cd-a9a6-308ca75d1770 None None] MFA Rules not processed for user `361e9184fad14abb820cad0fd93f9323`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:45.777275 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9408d2bb-062b-43cd-a9a6-308ca75d1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:45.840629 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1398/2786] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:57:45.852319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:45.854135 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:45.946224 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:45.955454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288398-ba48-48b2-905c-d3bb1d192130 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:45.961486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06398b3a-1707-4e44-8a30-d03848746e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d604a09f0e04fd2ac41f31a4e13e166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:45.962137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398b3a-1707-4e44-8a30-d03848746e87 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:45.962583 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398b3a-1707-4e44-8a30-d03848746e87 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:45.962868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398b3a-1707-4e44-8a30-d03848746e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:45.971385 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06398b3a-1707-4e44-8a30-d03848746e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:45.972994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06398b3a-1707-4e44-8a30-d03848746e87 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:45.982314 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1389/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:55.302326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408d2bb-062b-43cd-a9a6-308ca75d1770 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:55.362777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408d2bb-062b-43cd-a9a6-308ca75d1770 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:55.367305 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:55.368177 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:55.368464 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:55.368752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] PATH_INFO: `/v3/users/361e9184fad14abb820cad0fd93f9323` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:55.369935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=361e9184fad14abb820cad0fd93f9323)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:55.371887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:55.416206 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361e9184fad14abb820cad0fd93f9323'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.417995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:55.429778 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361e9184fad14abb820cad0fd93f9323'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.436673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361e9184fad14abb820cad0fd93f9323'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.443993 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361e9184fad14abb820cad0fd93f9323'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.444597 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361e9184fad14abb820cad0fd93f9323'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.450562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1399/2788] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:57:55 2022] DELETE /identity/v3/users/361e9184fad14abb820cad0fd93f9323 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:55.455103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:55.455602 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:55.455698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:55.473479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:55.474719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:55.535094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1390/2789] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:55.544706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:55.546219 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:55.602782 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16642-6138-4030-b91c-399674f55e9e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:55.606695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a440f5-9e12-4b6d-b159-ff02ae7ade97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:55.607392 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a440f5-9e12-4b6d-b159-ff02ae7ade97 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:55.607673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a440f5-9e12-4b6d-b159-ff02ae7ade97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:55.607949 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a440f5-9e12-4b6d-b159-ff02ae7ade97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:55.619153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a440f5-9e12-4b6d-b159-ff02ae7ade97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:55.620560 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a440f5-9e12-4b6d-b159-ff02ae7ade97 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:55.629910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1400/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:55.897052 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:55.898525 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:55.910705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a5625-193b-49dd-8405-2a56469a7192 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:55.915359 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:55.916240 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:55.916520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:55.916796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] PATH_INFO: `/v3/projects/b54fd58aad814477b5e5e1eb44c5ca70` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:55.918222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54fd58aad814477b5e5e1eb44c5ca70)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:55.920163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:55.967457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54fd58aad814477b5e5e1eb44c5ca70', 'request_id': 'req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.974479 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54fd58aad814477b5e5e1eb44c5ca70', 'request_id': 'req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.979930 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54fd58aad814477b5e5e1eb44c5ca70', 'request_id': 'req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.991050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] The token cache is being invalidate because project b54fd58aad814477b5e5e1eb44c5ca70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:57:55.991340 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.991982 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2fa322ff-f3d9-4ce1-9563-dcd5aa102287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:55.993527 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1391/2791] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:57:55 2022] DELETE /identity/v3/projects/b54fd58aad814477b5e5e1eb44c5ca70 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:55.998925 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e8d4-30a3-4ef6-8826-f5a7b07bf97c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:55.999214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e8d4-30a3-4ef6-8826-f5a7b07bf97c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:55.999538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e8d4-30a3-4ef6-8826-f5a7b07bf97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.017487 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ad10e8d4-30a3-4ef6-8826-f5a7b07bf97c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:56.018722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ad10e8d4-30a3-4ef6-8826-f5a7b07bf97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:56.077611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1401/2792] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:56.085483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597c81a-a0cb-444b-8e0e-19b6c423bc2a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.085805 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597c81a-a0cb-444b-8e0e-19b6c423bc2a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.086087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597c81a-a0cb-444b-8e0e-19b6c423bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.104389 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9597c81a-a0cb-444b-8e0e-19b6c423bc2a None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:56.105852 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9597c81a-a0cb-444b-8e0e-19b6c423bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:56.113802 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1392/2793] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:56.118026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e8d4-30a3-4ef6-8826-f5a7b07bf97c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.128270 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e8d4-30a3-4ef6-8826-f5a7b07bf97c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.132864 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.133524 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.133813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.134097 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.134869 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:57:56.135179 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.136787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.149142 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1402/2794] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:57:56.153545 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597c81a-a0cb-444b-8e0e-19b6c423bc2a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.162708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597c81a-a0cb-444b-8e0e-19b6c423bc2a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.167275 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.168003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.168279 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.168553 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.169239 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.171218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.196531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1393/2795] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:57:56 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:56.200658 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.211044 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0aae5-b89e-41f3-bdab-f733fb01ffe0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.262846 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:56.270029 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.270995 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.271605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.271948 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.272666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.274761 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.295596 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1403/2796] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:57:56 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:56.300096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.312200 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0e20c-cd68-435a-8b9a-4154ad52dcdd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.316867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.317549 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.317835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.318106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.318907 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.320495 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.331599 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1394/2797] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:56.335636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.345644 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071d48a-f6df-43b1-aada-1958620974c1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.350366 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663923e7-da51-486f-a82c-dc14fda8699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.351031 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663923e7-da51-486f-a82c-dc14fda8699a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.351314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663923e7-da51-486f-a82c-dc14fda8699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.351594 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663923e7-da51-486f-a82c-dc14fda8699a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.352349 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663923e7-da51-486f-a82c-dc14fda8699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.353935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663923e7-da51-486f-a82c-dc14fda8699a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.365661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1404/2798] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:56.369884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.380787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71ae46-9f72-4d45-87a0-89488c142946 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.385499 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.386431 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.386722 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.387003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] PATH_INFO: `/v3/projects/390ef294a4174cb78077b02cd31a0c92/users/d1a08a923cf24d92ac661dd7e62bcd9c/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.402103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] RBAC: Authorizing `identity:create_grant(project_id=390ef294a4174cb78077b02cd31a0c92, user_id=d1a08a923cf24d92ac661dd7e62bcd9c, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.404891 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.421071 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1395/2799] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:56 2022] PUT /identity/v3/projects/390ef294a4174cb78077b02cd31a0c92/users/d1a08a923cf24d92ac661dd7e62bcd9c/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:56.482899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507922-e2fc-4fae-9b40-5c5f7479caef None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.483186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507922-e2fc-4fae-9b40-5c5f7479caef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.483493 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507922-e2fc-4fae-9b40-5c5f7479caef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.510787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-86507922-e2fc-4fae-9b40-5c5f7479caef None None] MFA Rules not processed for user `d1a08a923cf24d92ac661dd7e62bcd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:56.512041 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-86507922-e2fc-4fae-9b40-5c5f7479caef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:56.575642 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1405/2800] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:56.580072 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.589099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:56.644787 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fcda6-a30e-40ef-95a6-066efa99071d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.649394 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.650070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.650391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.650675 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.651398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.653397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.680199 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1396/2801] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:57:56 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:56.684184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507922-e2fc-4fae-9b40-5c5f7479caef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.695162 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507922-e2fc-4fae-9b40-5c5f7479caef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.752605 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.753260 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.753542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.753812 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.754540 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.756405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.775637 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1406/2802] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:57:56 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:56.780091 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.790413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455757a-9520-4ed2-bc18-386a6cee95cb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.796319 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.797004 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.797293 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.797577 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.798345 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.799998 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.811134 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1397/2803] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:56.815350 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.825457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14e45f-c421-481b-8099-1fba4c24bb11 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.830154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.830997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.831282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.831562 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] PATH_INFO: `/v3/projects/89e6be7c7b0743af9105240c73cba8ec/users/161d589ce44d443196a426192f26be1e/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.847234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e6be7c7b0743af9105240c73cba8ec, user_id=161d589ce44d443196a426192f26be1e, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.849887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.864984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1407/2804] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:56 2022] PUT /identity/v3/projects/89e6be7c7b0743af9105240c73cba8ec/users/161d589ce44d443196a426192f26be1e/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:56.868819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.879096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a47ff4-343c-474c-bb81-17bf8bb5bca0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.936081 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e495-b4ed-4cb4-b658-e5e699b0b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.936774 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e495-b4ed-4cb4-b658-e5e699b0b4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.937055 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e495-b4ed-4cb4-b658-e5e699b0b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.937329 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e495-b4ed-4cb4-b658-e5e699b0b4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.938101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e495-b4ed-4cb4-b658-e5e699b0b4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.939779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e495-b4ed-4cb4-b658-e5e699b0b4a7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.949620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1398/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:56.953795 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:56.963875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012d8b-0c90-4458-8967-6fe519e77dfd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:56.969301 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:56.970192 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.970479 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.970754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] PATH_INFO: `/v3/projects/89e6be7c7b0743af9105240c73cba8ec/users/161d589ce44d443196a426192f26be1e/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:56.972950 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e6be7c7b0743af9105240c73cba8ec, user_id=161d589ce44d443196a426192f26be1e, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:56.975604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:56.986654 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1408/2806] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:56 2022] PUT /identity/v3/projects/89e6be7c7b0743af9105240c73cba8ec/users/161d589ce44d443196a426192f26be1e/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:56.996524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7503d1-19c3-49ca-a439-e5557d5ecb25 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:56.996817 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7503d1-19c3-49ca-a439-e5557d5ecb25 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:56.997098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7503d1-19c3-49ca-a439-e5557d5ecb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:57.022914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-db7503d1-19c3-49ca-a439-e5557d5ecb25 None None] MFA Rules not processed for user `161d589ce44d443196a426192f26be1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:57.024120 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-db7503d1-19c3-49ca-a439-e5557d5ecb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:57.090992 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1399/2807] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:57.102459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:57.104235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:57.124852 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:57.165676 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e8d3-b4d9-427d-b4d3-5b50bf16fef5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:57.169732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c05747-434e-4c3f-9ab9-e6acd7483b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:57.170447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c05747-434e-4c3f-9ab9-e6acd7483b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:57.170798 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c05747-434e-4c3f-9ab9-e6acd7483b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:57.171119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c05747-434e-4c3f-9ab9-e6acd7483b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:57.180022 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c05747-434e-4c3f-9ab9-e6acd7483b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:57.181425 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c05747-434e-4c3f-9ab9-e6acd7483b29 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:57.190849 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1409/2808] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:57.581666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7503d1-19c3-49ca-a439-e5557d5ecb25 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:57.585773 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:57.646656 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7503d1-19c3-49ca-a439-e5557d5ecb25 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:57.651190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:57.652094 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:57.652369 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:57.652668 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] PATH_INFO: `/v3/users/d1a08a923cf24d92ac661dd7e62bcd9c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:57.653888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a08a923cf24d92ac661dd7e62bcd9c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:57.655900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:57.712594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a08a923cf24d92ac661dd7e62bcd9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:57.713259 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a08a923cf24d92ac661dd7e62bcd9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:57.720235 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a08a923cf24d92ac661dd7e62bcd9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:57.720889 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a08a923cf24d92ac661dd7e62bcd9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:57.728292 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a08a923cf24d92ac661dd7e62bcd9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:57.747381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1400/2809] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:57:57 2022] DELETE /identity/v3/users/d1a08a923cf24d92ac661dd7e62bcd9c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:57.752553 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:57.753036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:57.753238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:57.769878 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:57.771202 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:57.829266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1410/2810] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:57.839396 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:57.840918 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:57.903181 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77f7c2-713d-4230-b63b-77baa58015a1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:57.906902 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:57.907554 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:57.907836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:57.908110 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:57.917606 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:57.919070 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:57.929125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1401/2811] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:58.197752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:58.199394 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:58.212548 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f69f83-32a6-4709-8d51-14013d5d420c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:58.217924 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:58.218839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:58.219119 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:58.219393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] PATH_INFO: `/v3/projects/390ef294a4174cb78077b02cd31a0c92` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:58.220619 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390ef294a4174cb78077b02cd31a0c92)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:58.222573 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:58.270046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390ef294a4174cb78077b02cd31a0c92', 'request_id': 'req-7f2f39fe-79ca-4957-963e-7405d62edda2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.276136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390ef294a4174cb78077b02cd31a0c92', 'request_id': 'req-7f2f39fe-79ca-4957-963e-7405d62edda2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.281565 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390ef294a4174cb78077b02cd31a0c92', 'request_id': 'req-7f2f39fe-79ca-4957-963e-7405d62edda2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.293865 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] The token cache is being invalidate because project 390ef294a4174cb78077b02cd31a0c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:57:58.294153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.294787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.296329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1411/2812] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:57:58 2022] DELETE /identity/v3/projects/390ef294a4174cb78077b02cd31a0c92 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:58.300281 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:58.309806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3073d5-3660-44f8-98d0-e2ed0e9c0cd8 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:58.330744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:58.368448 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:58.369324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:58.369609 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:58.369890 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] PATH_INFO: `/v3/users/161d589ce44d443196a426192f26be1e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:58.371113 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=161d589ce44d443196a426192f26be1e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:58.373022 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:58.420003 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161d589ce44d443196a426192f26be1e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.420660 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161d589ce44d443196a426192f26be1e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.428496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161d589ce44d443196a426192f26be1e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.429202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161d589ce44d443196a426192f26be1e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.437373 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-de86d938-2bcb-4178-860e-24dd17c606cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161d589ce44d443196a426192f26be1e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.456116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1402/2813] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:57:58 2022] DELETE /identity/v3/users/161d589ce44d443196a426192f26be1e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:58.726154 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:58.727668 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:58.741707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f39fe-79ca-4957-963e-7405d62edda2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:58.784163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:58.800196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:58.801089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:58.801374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:58.801650 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] PATH_INFO: `/v3/projects/89e6be7c7b0743af9105240c73cba8ec` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:58.802903 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e6be7c7b0743af9105240c73cba8ec)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:58.804789 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:58.849015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e6be7c7b0743af9105240c73cba8ec', 'request_id': 'req-d501fed3-190a-4b64-9243-64214733a33a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.854975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e6be7c7b0743af9105240c73cba8ec', 'request_id': 'req-d501fed3-190a-4b64-9243-64214733a33a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.861058 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e6be7c7b0743af9105240c73cba8ec', 'request_id': 'req-d501fed3-190a-4b64-9243-64214733a33a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.873813 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] The token cache is being invalidate because project 89e6be7c7b0743af9105240c73cba8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:57:58.874111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.874770 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d501fed3-190a-4b64-9243-64214733a33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:58.876314 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1412/2814] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:57:58 2022] DELETE /identity/v3/projects/89e6be7c7b0743af9105240c73cba8ec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:57:58.881151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6fca-12d4-437d-872d-13c83aacee3b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:58.881633 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6fca-12d4-437d-872d-13c83aacee3b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:58.881749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6fca-12d4-437d-872d-13c83aacee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:58.900007 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b1ef6fca-12d4-437d-872d-13c83aacee3b None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:58.901201 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b1ef6fca-12d4-437d-872d-13c83aacee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:58.960021 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1403/2815] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:58.968328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db7f8-ce18-442b-b5a4-a2c3f5fec68e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:58.968620 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db7f8-ce18-442b-b5a4-a2c3f5fec68e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:58.968978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db7f8-ce18-442b-b5a4-a2c3f5fec68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:58.987640 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-df6db7f8-ce18-442b-b5a4-a2c3f5fec68e None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:58.988912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-df6db7f8-ce18-442b-b5a4-a2c3f5fec68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:59.002873 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1413/2816] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:59.003088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6fca-12d4-437d-872d-13c83aacee3b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.010926 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6fca-12d4-437d-872d-13c83aacee3b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.015718 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.016383 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.016662 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.016934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.017663 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:57:59.017967 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.019883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.031863 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1404/2817] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:57:59.036186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db7f8-ce18-442b-b5a4-a2c3f5fec68e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.046020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db7f8-ce18-442b-b5a4-a2c3f5fec68e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.050665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.051325 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.051609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.051888 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.052576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.054471 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.080281 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1414/2818] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:57:59 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:59.084531 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.094788 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41361e7-cc56-4411-9cd2-360200578478 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.122867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:59.153207 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.153879 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.154163 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.155051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.155755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.157674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.179175 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1405/2819] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:57:59 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:57:59.183482 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.194333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f98027-08d4-4ae7-ae0d-bd3cd1a49176 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.199087 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.199765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.200052 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.200328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.201064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.203403 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.214431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1415/2820] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:59.218716 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.228932 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7124a3-3027-4e4f-becf-5a7334bcf48a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.234779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c0895-c964-47ac-9a1a-754164347552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.235485 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c0895-c964-47ac-9a1a-754164347552 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.235759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c0895-c964-47ac-9a1a-754164347552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.236031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c0895-c964-47ac-9a1a-754164347552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.236762 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c0895-c964-47ac-9a1a-754164347552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.238404 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c0895-c964-47ac-9a1a-754164347552 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.250117 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1406/2821] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:59.254466 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.264537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8360-f78a-4288-91f0-fd5d94fc2831 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.269218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.270103 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.270416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.270697 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] PATH_INFO: `/v3/projects/fdaeb4557ab34a3aa116d2a83e3e9c0f/users/a6902bf0dda349afa99327bbde9748ea/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.286088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdaeb4557ab34a3aa116d2a83e3e9c0f, user_id=a6902bf0dda349afa99327bbde9748ea, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.288738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.301459 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1416/2822] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:59 2022] PUT /identity/v3/projects/fdaeb4557ab34a3aa116d2a83e3e9c0f/users/a6902bf0dda349afa99327bbde9748ea/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:59.313216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad72567-29be-4db1-8be8-797a900c7104 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.313502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad72567-29be-4db1-8be8-797a900c7104 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.313775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad72567-29be-4db1-8be8-797a900c7104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.339666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7ad72567-29be-4db1-8be8-797a900c7104 None None] MFA Rules not processed for user `a6902bf0dda349afa99327bbde9748ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:59.340900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7ad72567-29be-4db1-8be8-797a900c7104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:59.404483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1407/2823] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:59.408942 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.468708 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11098b25-1494-44fb-bfe0-3116973e6031 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.473364 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.474019 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.474330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.474607 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.475300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.477159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.492105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:59.505831 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1417/2824] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:57:59 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:59.509867 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad72567-29be-4db1-8be8-797a900c7104 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.520560 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad72567-29be-4db1-8be8-797a900c7104 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.575370 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.576038 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.576356 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.576632 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.577317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.579262 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.599295 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1408/2825] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:57:59 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:59.603264 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.614385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5866-b00f-445c-9933-c4307b5087dd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.619043 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.619727 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.620011 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.620288 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.621020 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.622652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.633514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1418/2826] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:57:59.637616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.647377 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b42fc-6eed-4442-bce6-73685ef3539a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.651893 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.652764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.653044 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.653317 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] PATH_INFO: `/v3/projects/4d99268706f2420491b0bc8e37ab30cd/users/9efd64b2dc5f4520a0498cb7e8f4819d/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.668882 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99268706f2420491b0bc8e37ab30cd, user_id=9efd64b2dc5f4520a0498cb7e8f4819d, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.673756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.689083 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1409/2827] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:59 2022] PUT /identity/v3/projects/4d99268706f2420491b0bc8e37ab30cd/users/9efd64b2dc5f4520a0498cb7e8f4819d/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:59.693282 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.703327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa99a-3bcc-4831-9f3f-788efe5eef18 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.760593 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1f4d-65d1-41bb-87c5-877c8f0a228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.761196 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1f4d-65d1-41bb-87c5-877c8f0a228b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.761474 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1f4d-65d1-41bb-87c5-877c8f0a228b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.761754 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1f4d-65d1-41bb-87c5-877c8f0a228b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.762530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1f4d-65d1-41bb-87c5-877c8f0a228b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.764132 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1f4d-65d1-41bb-87c5-877c8f0a228b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.773822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1419/2828] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:59.778103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.785190 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:59.788908 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4895bc0-d347-4ee2-ae0d-2dedb92a5197 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:59.794645 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:59.796098 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.796386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.796768 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] PATH_INFO: `/v3/projects/4d99268706f2420491b0bc8e37ab30cd/users/9efd64b2dc5f4520a0498cb7e8f4819d/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.798822 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99268706f2420491b0bc8e37ab30cd, user_id=9efd64b2dc5f4520a0498cb7e8f4819d, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:59.801530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:59.812490 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1410/2829] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:59 2022] PUT /identity/v3/projects/4d99268706f2420491b0bc8e37ab30cd/users/9efd64b2dc5f4520a0498cb7e8f4819d/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:59.822491 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b4ed-877e-4cb4-b778-0ed13d426844 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:59.822955 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b4ed-877e-4cb4-b778-0ed13d426844 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:59.823062 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b4ed-877e-4cb4-b778-0ed13d426844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:59.851885 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-19c4b4ed-877e-4cb4-b778-0ed13d426844 None None] MFA Rules not processed for user `9efd64b2dc5f4520a0498cb7e8f4819d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:59.853300 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-19c4b4ed-877e-4cb4-b778-0ed13d426844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:59.923348 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1420/2830] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:59.936122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:59.937904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:00.004343 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fb57f-d6ab-433d-bde7-ade00b31d4ed admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:00.007965 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:00.008616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:00.008924 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:00.009206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:00.018391 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:00.019759 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:00.029144 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1411/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:00.342229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4b4ed-877e-4cb4-b778-0ed13d426844 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:00.352218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4b4ed-877e-4cb4-b778-0ed13d426844 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:00.357070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd64b2dc5f4520a0498cb7e8f4819d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d99268706f2420491b0bc8e37ab30cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:00.358298 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:00.358589 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:00.358868 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:00.359604 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:00.359917 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:00.361546 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:00.374038 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1421/2832] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:00.378136 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:00.387206 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388514b-b052-4ccf-8210-39a1e0ecc999 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:00.391780 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd64b2dc5f4520a0498cb7e8f4819d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d99268706f2420491b0bc8e37ab30cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:00.392422 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:00.392706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:00.392980 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:00.393670 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:00.395582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:00.421760 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1412/2833] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:00 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:00.425756 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:00.435837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e54d2-1262-483d-afe1-e8e0e5a08e57 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:00.485423 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:00.495545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd64b2dc5f4520a0498cb7e8f4819d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d99268706f2420491b0bc8e37ab30cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:00.496299 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:00.496510 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:00.496790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:00.497609 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:00.497938 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:00.499627 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:00.511228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1422/2834] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:00.547593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:00.557674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf083a-6bbc-4ab9-9086-f462e1dfcebd tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:00.562325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd64b2dc5f4520a0498cb7e8f4819d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d99268706f2420491b0bc8e37ab30cd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:00.563182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:00.563468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:00.563742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] PATH_INFO: `/v3/projects/bf3a56cd83e140b3bb5077ec6bb0b1a8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:00.564935 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf3a56cd83e140b3bb5077ec6bb0b1a8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:00.566871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:00.617198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3a56cd83e140b3bb5077ec6bb0b1a8', 'request_id': 'req-313ca4b1-2828-433f-84f9-cd28dde09d72'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:00.624679 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3a56cd83e140b3bb5077ec6bb0b1a8', 'request_id': 'req-313ca4b1-2828-433f-84f9-cd28dde09d72'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:00.630265 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3a56cd83e140b3bb5077ec6bb0b1a8', 'request_id': 'req-313ca4b1-2828-433f-84f9-cd28dde09d72'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:00.641284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] The token cache is being invalidate because project bf3a56cd83e140b3bb5077ec6bb0b1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:00.641575 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:00.642263 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-313ca4b1-2828-433f-84f9-cd28dde09d72 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:00.643827 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1413/2835] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:00 2022] DELETE /identity/v3/projects/bf3a56cd83e140b3bb5077ec6bb0b1a8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:00.831732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:00.833494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:00.906652 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4687a-059b-4486-bce2-8089c0ddd385 tempest-VolumeQuotaClassesTest-1902876926 tempest-VolumeQuotaClassesTest-1902876926-project-admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:00.961340 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:00.962228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:00.962514 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:00.962789 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] PATH_INFO: `/v3/users/a6902bf0dda349afa99327bbde9748ea` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:00.964002 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6902bf0dda349afa99327bbde9748ea)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:00.966193 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:01.013385 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6902bf0dda349afa99327bbde9748ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.025136 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6902bf0dda349afa99327bbde9748ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.032214 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6902bf0dda349afa99327bbde9748ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.039065 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6902bf0dda349afa99327bbde9748ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.039716 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6902bf0dda349afa99327bbde9748ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.045945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1423/2836] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:00 2022] DELETE /identity/v3/users/a6902bf0dda349afa99327bbde9748ea => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:01.050457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:01.050969 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:01.051101 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:01.069703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:01.070839 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:01.116338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:01.129096 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1414/2837] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:01.138585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:01.140074 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:01.155578 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:01.200367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adb3da-c48e-4970-ade8-9014e308f3f6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:01.204602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:01.205244 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:01.205530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:01.205805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:01.214707 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:01.216118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:01.225492 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1424/2838] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:01.491823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:01.495323 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:01.507719 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461b6aa-9fac-4afa-8dc0-d23eba63c2e9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:01.512695 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:01.513573 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:01.513853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:01.514125 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] PATH_INFO: `/v3/projects/fdaeb4557ab34a3aa116d2a83e3e9c0f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:01.515351 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdaeb4557ab34a3aa116d2a83e3e9c0f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:01.517261 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:01.564775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdaeb4557ab34a3aa116d2a83e3e9c0f', 'request_id': 'req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.572166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdaeb4557ab34a3aa116d2a83e3e9c0f', 'request_id': 'req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.577684 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdaeb4557ab34a3aa116d2a83e3e9c0f', 'request_id': 'req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.588327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] The token cache is being invalidate because project fdaeb4557ab34a3aa116d2a83e3e9c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:01.588617 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.589382 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.590970 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1415/2839] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:01 2022] DELETE /identity/v3/projects/fdaeb4557ab34a3aa116d2a83e3e9c0f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:01.595156 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:01.604732 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dcd1e-c275-4626-96db-00e63588e6b4 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:01.661588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:01.662412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:01.662694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:01.662969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] PATH_INFO: `/v3/users/9efd64b2dc5f4520a0498cb7e8f4819d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:01.664152 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efd64b2dc5f4520a0498cb7e8f4819d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:01.666036 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:01.709283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efd64b2dc5f4520a0498cb7e8f4819d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.721513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efd64b2dc5f4520a0498cb7e8f4819d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.728161 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efd64b2dc5f4520a0498cb7e8f4819d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.735766 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efd64b2dc5f4520a0498cb7e8f4819d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.736381 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64492bb4-7c83-4c1d-876d-98443a02b095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efd64b2dc5f4520a0498cb7e8f4819d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:01.742174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1425/2840] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:01 2022] DELETE /identity/v3/users/9efd64b2dc5f4520a0498cb7e8f4819d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:02.017025 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.018520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:02.031493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dca46-fbc1-4e6d-bc9e-060b499bc6ea admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.090557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.091433 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.091714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.092051 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] PATH_INFO: `/v3/projects/4d99268706f2420491b0bc8e37ab30cd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.093416 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d99268706f2420491b0bc8e37ab30cd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.095350 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.143245 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d99268706f2420491b0bc8e37ab30cd', 'request_id': 'req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:02.151102 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d99268706f2420491b0bc8e37ab30cd', 'request_id': 'req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:02.157045 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d99268706f2420491b0bc8e37ab30cd', 'request_id': 'req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:02.168192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] The token cache is being invalidate because project 4d99268706f2420491b0bc8e37ab30cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:02.168474 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:02.169109 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d45d3455-cd01-4db8-bf8a-52a0c0ef52fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:02.170709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1416/2841] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:02 2022] DELETE /identity/v3/projects/4d99268706f2420491b0bc8e37ab30cd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:02.175842 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ead9e-9553-48cd-8fa2-d343ff8bcfc5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.176363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ead9e-9553-48cd-8fa2-d343ff8bcfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.176468 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ead9e-9553-48cd-8fa2-d343ff8bcfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.196242 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d41ead9e-9553-48cd-8fa2-d343ff8bcfc5 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:02.197357 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d41ead9e-9553-48cd-8fa2-d343ff8bcfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:02.225897 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:02.258616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1426/2842] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:02.267533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b55c6-376e-4050-80e5-28f4e5c07b86 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.267820 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b55c6-376e-4050-80e5-28f4e5c07b86 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.268097 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b55c6-376e-4050-80e5-28f4e5c07b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.285731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d25b55c6-376e-4050-80e5-28f4e5c07b86 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:02.286963 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d25b55c6-376e-4050-80e5-28f4e5c07b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:02.294800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1417/2843] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:02.299390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ead9e-9553-48cd-8fa2-d343ff8bcfc5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.309116 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ead9e-9553-48cd-8fa2-d343ff8bcfc5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.314257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.314911 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.315186 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.315455 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.316178 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:02.316484 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.318056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.329402 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1427/2844] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:02.333598 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b55c6-376e-4050-80e5-28f4e5c07b86 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.338106 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:02.344153 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b55c6-376e-4050-80e5-28f4e5c07b86 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.349710 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.350386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.350669 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.350942 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.351627 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.353535 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.379892 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1418/2845] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:02 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:02.384064 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.393906 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e20b-8ace-46de-972e-7f08e4f936c8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.448472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.449572 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.449920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.450139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.450874 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.452765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.472616 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1428/2846] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:02 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:02.476776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.488482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1a4a-b967-43a2-bdf6-ece2708b432d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.493312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.493985 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.494305 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.494698 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.495470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.497578 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.509806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1419/2847] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:58:02.513805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.523746 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8a9a-11ff-489c-977f-2abb018867e7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.528571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faca6e-eadf-4af8-aa72-507362be4ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.529224 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faca6e-eadf-4af8-aa72-507362be4ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.529509 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faca6e-eadf-4af8-aa72-507362be4ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.529790 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faca6e-eadf-4af8-aa72-507362be4ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.530568 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faca6e-eadf-4af8-aa72-507362be4ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.532159 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faca6e-eadf-4af8-aa72-507362be4ad3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.542200 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1429/2848] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:02.547005 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.556968 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624a54-75d4-4f85-b8af-2f314152233e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.562289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.563182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.563468 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.563746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] PATH_INFO: `/v3/projects/153b7c7a1dfa42c5b839e13037ffc08e/users/d7c8f534795b47508f77e32cab6001e5/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.578681 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153b7c7a1dfa42c5b839e13037ffc08e, user_id=d7c8f534795b47508f77e32cab6001e5, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.581381 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.594901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1420/2849] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:02 2022] PUT /identity/v3/projects/153b7c7a1dfa42c5b839e13037ffc08e/users/d7c8f534795b47508f77e32cab6001e5/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:02.605227 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745288c-4c3f-4351-8a11-4641d9c339ee None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.605393 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745288c-4c3f-4351-8a11-4641d9c339ee None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.605582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745288c-4c3f-4351-8a11-4641d9c339ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.632283 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5745288c-4c3f-4351-8a11-4641d9c339ee None None] MFA Rules not processed for user `d7c8f534795b47508f77e32cab6001e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:02.633485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5745288c-4c3f-4351-8a11-4641d9c339ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:02.696978 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1430/2850] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:02.701687 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.764899 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e71d8b-0585-4f7f-9acb-7059478c4db0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.769793 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.770493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.770776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.771048 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.771749 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.773706 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.802730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1421/2851] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:02 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:02.806664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745288c-4c3f-4351-8a11-4641d9c339ee None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.817787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745288c-4c3f-4351-8a11-4641d9c339ee None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.847729 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:02.877703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.878427 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.878706 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.878981 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.879685 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.881602 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.904967 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1431/2852] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:02 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:02.908823 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.924018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79c42-c510-4c6c-a317-d8ac45fe7c48 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.928653 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.929321 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.929638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.929911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.930676 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.932272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.943388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1422/2853] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:02.947458 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.958499 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7957-cb07-4b10-84f4-e77d3c0d5d59 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.963059 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2b165-2b8f-4a5a-bcbe-e13f13769f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.963714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2b165-2b8f-4a5a-bcbe-e13f13769f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.963997 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2b165-2b8f-4a5a-bcbe-e13f13769f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.964269 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2b165-2b8f-4a5a-bcbe-e13f13769f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:02.965017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2b165-2b8f-4a5a-bcbe-e13f13769f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:02.966645 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2b165-2b8f-4a5a-bcbe-e13f13769f3c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:02.976324 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1432/2854] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:02.980312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:02.990880 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6462e4-c683-47bb-99b6-340665f24f70 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:02.995384 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:02.996256 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:02.996541 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:02.996819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] PATH_INFO: `/v3/projects/8713a132270741cdb564dc5f9d1f9d26/users/57d0a5d1210647509ef5e4032f3eef59/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.012168 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8713a132270741cdb564dc5f9d1f9d26, user_id=57d0a5d1210647509ef5e4032f3eef59, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.014901 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.031810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1423/2855] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:02 2022] PUT /identity/v3/projects/8713a132270741cdb564dc5f9d1f9d26/users/57d0a5d1210647509ef5e4032f3eef59/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:03.042397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d71a0-3ba0-4ac4-94bd-f9e92eefa0b0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.042713 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d71a0-3ba0-4ac4-94bd-f9e92eefa0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.042998 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d71a0-3ba0-4ac4-94bd-f9e92eefa0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.069261 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-813d71a0-3ba0-4ac4-94bd-f9e92eefa0b0 None None] MFA Rules not processed for user `57d0a5d1210647509ef5e4032f3eef59`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:03.070497 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-813d71a0-3ba0-4ac4-94bd-f9e92eefa0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:03.133539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1433/2856] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:03.137990 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:03.194647 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:03.201036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046da503-94e5-4e27-8db9-d8c7102a8db4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:03.206532 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:03.207197 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.207480 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.207755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.208457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.210439 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.236996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1424/2857] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:03 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:03.241373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d71a0-3ba0-4ac4-94bd-f9e92eefa0b0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:03.252277 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d71a0-3ba0-4ac4-94bd-f9e92eefa0b0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:03.306985 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:03.307648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.307931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.308209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.308893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.310840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.332027 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1434/2858] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:03 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:03.335951 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:03.346900 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a57cf-5de7-4c28-81c4-ca5153cae8b8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:03.351493 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:03.352152 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.352437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.352711 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.353438 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.355068 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.365811 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1425/2859] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:03.369875 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:03.380426 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21e03-ff01-4815-8948-0b7f7bea27df admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:03.385045 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:03.385921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.386238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.386520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] PATH_INFO: `/v3/projects/77ef9902b47d45aeb41b20df55d17bae/users/cc19c0d47c1d42a5a65d9add40472cbd/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.401502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ef9902b47d45aeb41b20df55d17bae, user_id=cc19c0d47c1d42a5a65d9add40472cbd, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.404143 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.417416 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1435/2860] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:03 2022] PUT /identity/v3/projects/77ef9902b47d45aeb41b20df55d17bae/users/cc19c0d47c1d42a5a65d9add40472cbd/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:03.421312 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:03.431202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa6f34-7656-4dd8-8ad2-d02c13a19f16 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:03.488157 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09dbda-aabc-4d24-9ec3-f981905bee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:03.488758 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09dbda-aabc-4d24-9ec3-f981905bee27 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.489042 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09dbda-aabc-4d24-9ec3-f981905bee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.489348 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09dbda-aabc-4d24-9ec3-f981905bee27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.490112 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09dbda-aabc-4d24-9ec3-f981905bee27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.491745 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09dbda-aabc-4d24-9ec3-f981905bee27 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.502363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1426/2861] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:58:03.506457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:03.513584 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:03.517966 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438cf2-3426-4baf-a40d-833d43d1c7b2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:03.523682 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:03.524669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.524954 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.525229 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] PATH_INFO: `/v3/projects/77ef9902b47d45aeb41b20df55d17bae/users/cc19c0d47c1d42a5a65d9add40472cbd/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.527329 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ef9902b47d45aeb41b20df55d17bae, user_id=cc19c0d47c1d42a5a65d9add40472cbd, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.529921 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.540164 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1436/2862] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:03 2022] PUT /identity/v3/projects/77ef9902b47d45aeb41b20df55d17bae/users/cc19c0d47c1d42a5a65d9add40472cbd/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:03.551248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.551611 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.551895 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.578502 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] MFA Rules not processed for user `cc19c0d47c1d42a5a65d9add40472cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:03.579707 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:03.646634 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1427/2863] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:03.657127 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:03.658859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:03.714916 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126b964-4228-4ade-a66d-e4e3dcbbac5c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:03.718595 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:03.719237 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:03.719521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:03.719797 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:03.728738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:03.730684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:03.740477 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1437/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:04.225501 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:04.227010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:04.240159 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9b362-32bc-4509-bd8f-5be85cae7c11 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:04.243904 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:04.244558 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:04.244843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:04.245145 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:04.290929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:04.305975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:04.307456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:04.316836 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1428/2865] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:58:06.648899 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:06.650289 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:06.720462 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcadce-f730-4a6d-935e-077a411c3d5e service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:06.725409 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:06.726063 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:06.726379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:06.726663 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:06.728505 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:06.740806 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:06.742413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:06.752582 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1438/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:08.326397 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:08.335781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2710-a423-42de-8789-03e19b1463bf service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:08.339390 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e8c4c-cc10-4154-b967-a0857d90d459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:08.340036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8c4c-cc10-4154-b967-a0857d90d459 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:08.340325 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8c4c-cc10-4154-b967-a0857d90d459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:08.340607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8c4c-cc10-4154-b967-a0857d90d459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:08.399462 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e8c4c-cc10-4154-b967-a0857d90d459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:08.400804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e8c4c-cc10-4154-b967-a0857d90d459 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:08.410473 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1429/2867] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:10.467046 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:10.532012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f85be-ad85-4d62-a50a-d3280507a1c2 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:10.536571 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:10.537451 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:10.537734 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:10.538015 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] PATH_INFO: `/v3/users/d7c8f534795b47508f77e32cab6001e5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:10.539286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c8f534795b47508f77e32cab6001e5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:10.541194 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:10.571411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:10.591405 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c8f534795b47508f77e32cab6001e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:10.602887 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c8f534795b47508f77e32cab6001e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:10.610435 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c8f534795b47508f77e32cab6001e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:10.617692 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c8f534795b47508f77e32cab6001e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:10.618513 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c8f534795b47508f77e32cab6001e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:10.624931 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1439/2868] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:10 2022] DELETE /identity/v3/users/d7c8f534795b47508f77e32cab6001e5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:10.629470 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:10.629962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:10.630080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:10.646776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:10.647929 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:10.707623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1430/2869] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:10.717360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:10.718794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:10.774822 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1af7-8fed-4cfb-b624-d2eb99c87518 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:10.778857 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:10.779545 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:10.779859 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:10.780141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:10.789122 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:10.790564 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:10.800592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1440/2870] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:11.071692 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:11.073496 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:11.085870 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeba35-50f4-49b9-9397-a454e9cb4259 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:11.091166 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:11.092040 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.092337 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.092603 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] PATH_INFO: `/v3/projects/153b7c7a1dfa42c5b839e13037ffc08e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.094387 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=153b7c7a1dfa42c5b839e13037ffc08e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:11.096457 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:11.144533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153b7c7a1dfa42c5b839e13037ffc08e', 'request_id': 'req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.151746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153b7c7a1dfa42c5b839e13037ffc08e', 'request_id': 'req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.158146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153b7c7a1dfa42c5b839e13037ffc08e', 'request_id': 'req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.169013 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] The token cache is being invalidate because project 153b7c7a1dfa42c5b839e13037ffc08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:11.169298 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.169934 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.172213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1431/2871] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:11 2022] DELETE /identity/v3/projects/153b7c7a1dfa42c5b839e13037ffc08e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:11.176172 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:11.185567 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455863fe-a02a-4155-bb5a-f8814b47fb30 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:11.240591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:11.241453 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.241738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.242018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] PATH_INFO: `/v3/users/57d0a5d1210647509ef5e4032f3eef59` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.243218 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d0a5d1210647509ef5e4032f3eef59)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:11.245133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:11.289556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d0a5d1210647509ef5e4032f3eef59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.290684 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:11.303787 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d0a5d1210647509ef5e4032f3eef59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.310824 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d0a5d1210647509ef5e4032f3eef59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.319763 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d0a5d1210647509ef5e4032f3eef59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.320444 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d0a5d1210647509ef5e4032f3eef59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.327648 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1441/2872] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:11 2022] DELETE /identity/v3/users/57d0a5d1210647509ef5e4032f3eef59 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:11.591756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:11.593834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:11.607338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4d77-6586-42b3-a0f3-f5e6dae6c74c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:11.615920 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:11.666682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:11.667538 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.667819 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.668090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] PATH_INFO: `/v3/projects/8713a132270741cdb564dc5f9d1f9d26` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.669272 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8713a132270741cdb564dc5f9d1f9d26)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:11.671320 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:11.717497 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8713a132270741cdb564dc5f9d1f9d26', 'request_id': 'req-e3b114c8-1114-4d64-bcb7-2f0c22585862'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.725744 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8713a132270741cdb564dc5f9d1f9d26', 'request_id': 'req-e3b114c8-1114-4d64-bcb7-2f0c22585862'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.732289 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8713a132270741cdb564dc5f9d1f9d26', 'request_id': 'req-e3b114c8-1114-4d64-bcb7-2f0c22585862'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.744191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] The token cache is being invalidate because project 8713a132270741cdb564dc5f9d1f9d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:11.744483 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.745155 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.746995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1432/2873] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:11 2022] DELETE /identity/v3/projects/8713a132270741cdb564dc5f9d1f9d26 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:11.751736 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:11.753203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:11.766876 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee208-3abb-4bf1-9ee8-c5e0592700e0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:11.821537 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:11.822428 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.822714 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.822988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] PATH_INFO: `/v3/users/cc19c0d47c1d42a5a65d9add40472cbd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.824174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc19c0d47c1d42a5a65d9add40472cbd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:11.826075 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:11.872042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc19c0d47c1d42a5a65d9add40472cbd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.884503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc19c0d47c1d42a5a65d9add40472cbd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.891881 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc19c0d47c1d42a5a65d9add40472cbd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.898811 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc19c0d47c1d42a5a65d9add40472cbd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.899431 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ac02821-c243-410b-a20a-063f56c89097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc19c0d47c1d42a5a65d9add40472cbd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.905498 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1442/2874] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:11 2022] DELETE /identity/v3/users/cc19c0d47c1d42a5a65d9add40472cbd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:12.180582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.182151 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:12.196090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b114c8-1114-4d64-bcb7-2f0c22585862 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.252137 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.253033 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.253313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.253586 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] PATH_INFO: `/v3/projects/77ef9902b47d45aeb41b20df55d17bae` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.254896 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ef9902b47d45aeb41b20df55d17bae)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.257099 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.299991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:12.303988 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ef9902b47d45aeb41b20df55d17bae', 'request_id': 'req-4884053c-6c43-410e-b720-ec0bae648968'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.311291 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ef9902b47d45aeb41b20df55d17bae', 'request_id': 'req-4884053c-6c43-410e-b720-ec0bae648968'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.317313 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ef9902b47d45aeb41b20df55d17bae', 'request_id': 'req-4884053c-6c43-410e-b720-ec0bae648968'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.328103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] The token cache is being invalidate because project 77ef9902b47d45aeb41b20df55d17bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:12.328392 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.329016 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4884053c-6c43-410e-b720-ec0bae648968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.330623 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1433/2875] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:12 2022] DELETE /identity/v3/projects/77ef9902b47d45aeb41b20df55d17bae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:12.336666 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4527-fa51-4993-bc6f-c95968645900 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.336987 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4527-fa51-4993-bc6f-c95968645900 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.337271 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4527-fa51-4993-bc6f-c95968645900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.355800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-15da4527-fa51-4993-bc6f-c95968645900 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:12.357276 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-15da4527-fa51-4993-bc6f-c95968645900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:12.397090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:12.417587 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1443/2876] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:12.426407 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c48af-81e3-4020-9246-2de29b70a9fd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.426635 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c48af-81e3-4020-9246-2de29b70a9fd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.426936 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c48af-81e3-4020-9246-2de29b70a9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.444876 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-604c48af-81e3-4020-9246-2de29b70a9fd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:12.446066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-604c48af-81e3-4020-9246-2de29b70a9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:12.453881 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1434/2877] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:12.457988 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4527-fa51-4993-bc6f-c95968645900 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.468234 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4527-fa51-4993-bc6f-c95968645900 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.472808 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.473470 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.473752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.474054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.474828 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:12.475153 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.476718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.489241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1444/2878] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:12.493492 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c48af-81e3-4020-9246-2de29b70a9fd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.502944 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c48af-81e3-4020-9246-2de29b70a9fd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.507568 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.508214 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.508498 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.508776 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.509471 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.511482 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.537058 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1435/2879] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:12.541228 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.552257 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e51fe2-fc84-404b-a588-49a36d6d9893 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.608238 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.609511 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.609800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.610082 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.610803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.612718 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.632839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1445/2880] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:58:12.636957 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.647122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aa8a3-5be0-444d-9eb9-4138a754cf52 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.651987 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.652649 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.652927 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.653198 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.653922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.656050 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.666454 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1436/2881] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:58:12.670191 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.680975 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1955ee-6636-4da5-a703-fcf6a980287a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.685478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d6b2-6822-4aba-a018-d3c319bd1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.686126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d6b2-6822-4aba-a018-d3c319bd1432 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.686441 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d6b2-6822-4aba-a018-d3c319bd1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.686720 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d6b2-6822-4aba-a018-d3c319bd1432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.687439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d6b2-6822-4aba-a018-d3c319bd1432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.689021 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d6b2-6822-4aba-a018-d3c319bd1432 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.698646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1446/2882] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:12.703220 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.712884 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5ade-ba96-4877-b382-c906c8847e50 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.717685 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.719182 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.719466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.719742 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] PATH_INFO: `/v3/projects/820a0e76e9ef400b8bdac20eb8989328/users/743415ffebf2420d9616741506634b41/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.734437 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=820a0e76e9ef400b8bdac20eb8989328, user_id=743415ffebf2420d9616741506634b41, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.737079 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.750674 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1437/2883] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:12 2022] PUT /identity/v3/projects/820a0e76e9ef400b8bdac20eb8989328/users/743415ffebf2420d9616741506634b41/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:12.762539 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c33b61-f5de-4e7d-abfd-930ebff6dba9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.763051 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c33b61-f5de-4e7d-abfd-930ebff6dba9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.763160 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c33b61-f5de-4e7d-abfd-930ebff6dba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.790118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-58c33b61-f5de-4e7d-abfd-930ebff6dba9 None None] MFA Rules not processed for user `743415ffebf2420d9616741506634b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:12.791398 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-58c33b61-f5de-4e7d-abfd-930ebff6dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:12.854130 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1447/2884] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:12.858943 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.920184 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa302ff-b240-466a-8689-4486d9cdce5b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.924797 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.925449 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.925730 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.926008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.926724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.928614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.955427 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1438/2885] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:12.959643 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c33b61-f5de-4e7d-abfd-930ebff6dba9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.971085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c33b61-f5de-4e7d-abfd-930ebff6dba9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.008617 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:13.027986 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.028664 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.028951 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.029235 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.029945 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.032475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.051785 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1448/2886] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:13.055779 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.065976 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35e83d-90ff-4483-bde8-90c6a4f46087 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.070614 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.071274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.071557 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.071846 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.072594 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.074202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.085063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1439/2887] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:13.089439 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.100141 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09868-586a-42f6-bde3-3ee8069360ee admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.104805 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.105829 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.106111 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.106673 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] PATH_INFO: `/v3/projects/330f55c514eb42c49ff0214a90845eba/users/a5a94b29b45b400aa1aad403beecbc28/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.120962 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330f55c514eb42c49ff0214a90845eba, user_id=a5a94b29b45b400aa1aad403beecbc28, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.123745 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.137698 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1449/2888] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:13 2022] PUT /identity/v3/projects/330f55c514eb42c49ff0214a90845eba/users/a5a94b29b45b400aa1aad403beecbc28/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:13.142018 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.151995 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35522ec-e267-4154-963d-626ca8a4e86b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.191451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:13.210233 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8f788-9d22-418f-989a-0ed269496b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.210864 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8f788-9d22-418f-989a-0ed269496b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.211148 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8f788-9d22-418f-989a-0ed269496b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.211451 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8f788-9d22-418f-989a-0ed269496b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.212212 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8f788-9d22-418f-989a-0ed269496b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.213807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8f788-9d22-418f-989a-0ed269496b18 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.223709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1440/2889] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:13.227858 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.238399 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645b938-44bf-4c69-a91f-c418a9057528 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.242969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.243839 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.244117 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.244391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] PATH_INFO: `/v3/projects/330f55c514eb42c49ff0214a90845eba/users/a5a94b29b45b400aa1aad403beecbc28/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.246397 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=330f55c514eb42c49ff0214a90845eba, user_id=a5a94b29b45b400aa1aad403beecbc28, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.249522 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.259588 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1450/2890] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:13 2022] PUT /identity/v3/projects/330f55c514eb42c49ff0214a90845eba/users/a5a94b29b45b400aa1aad403beecbc28/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:13.270027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6144-4f8c-46c6-b2c5-5969a5632046 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.270434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6144-4f8c-46c6-b2c5-5969a5632046 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.270782 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f6144-4f8c-46c6-b2c5-5969a5632046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.298689 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b89f6144-4f8c-46c6-b2c5-5969a5632046 None None] MFA Rules not processed for user `a5a94b29b45b400aa1aad403beecbc28`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:13.299903 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b89f6144-4f8c-46c6-b2c5-5969a5632046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:13.366146 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1441/2891] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:13.377603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.379362 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:13.433991 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37563cd-3928-4fd9-9920-1d67f701c27b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.438396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.439049 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.439332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.439610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.448739 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.450182 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.460396 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1451/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:13.557318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f6144-4f8c-46c6-b2c5-5969a5632046 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.568049 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f6144-4f8c-46c6-b2c5-5969a5632046 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.571642 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d74b8-7407-4e09-b868-8177aa3ac209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.572283 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d74b8-7407-4e09-b868-8177aa3ac209 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.572564 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d74b8-7407-4e09-b868-8177aa3ac209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.572834 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d74b8-7407-4e09-b868-8177aa3ac209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.632250 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d74b8-7407-4e09-b868-8177aa3ac209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.633683 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d74b8-7407-4e09-b868-8177aa3ac209 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.642771 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1442/2893] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:16.194914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:16.257528 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c550757-4da3-4c99-bf49-d0090b1c17ba service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:16.262090 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:16.262984 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:16.263265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:16.263542 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] PATH_INFO: `/v3/users/743415ffebf2420d9616741506634b41` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:16.264735 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743415ffebf2420d9616741506634b41)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:16.267355 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:16.304326 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:16.315203 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743415ffebf2420d9616741506634b41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.327133 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743415ffebf2420d9616741506634b41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.334600 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743415ffebf2420d9616741506634b41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.341837 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743415ffebf2420d9616741506634b41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.342530 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743415ffebf2420d9616741506634b41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.348952 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1452/2894] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:16 2022] DELETE /identity/v3/users/743415ffebf2420d9616741506634b41 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:16.353426 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:16.353914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:16.354031 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:16.377755 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:16.379036 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:16.435991 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1443/2895] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:16.445920 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:16.447332 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:16.505844 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ecea-a7d0-480b-bceb-a65e73600286 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:16.509665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:16.510374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:16.510661 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:16.510939 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:16.519933 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:16.521358 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:16.530840 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1453/2896] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:16.798226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:16.799754 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:16.811843 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:16.822808 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415a443-c22f-4c0d-9ca2-725457a78f50 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:16.827436 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:16.828308 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:16.828588 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:16.828860 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] PATH_INFO: `/v3/projects/820a0e76e9ef400b8bdac20eb8989328` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:16.830028 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=820a0e76e9ef400b8bdac20eb8989328)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:16.831964 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:16.878796 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820a0e76e9ef400b8bdac20eb8989328', 'request_id': 'req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.886008 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820a0e76e9ef400b8bdac20eb8989328', 'request_id': 'req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.891703 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820a0e76e9ef400b8bdac20eb8989328', 'request_id': 'req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.902853 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] The token cache is being invalidate because project 820a0e76e9ef400b8bdac20eb8989328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:16.903143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.903786 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:16.905336 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1444/2897] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:16 2022] DELETE /identity/v3/projects/820a0e76e9ef400b8bdac20eb8989328 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:16.909760 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:16.919286 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092569f-306b-4d9a-92dc-c2f6db9d4712 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:16.975343 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:16.976147 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:16.976438 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:16.976722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] PATH_INFO: `/v3/users/a5a94b29b45b400aa1aad403beecbc28` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:16.977914 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a94b29b45b400aa1aad403beecbc28)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:16.979871 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.028519 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a94b29b45b400aa1aad403beecbc28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.036611 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:17.042006 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a94b29b45b400aa1aad403beecbc28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.051085 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a94b29b45b400aa1aad403beecbc28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.058516 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a94b29b45b400aa1aad403beecbc28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.059139 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8691a1e0-5758-40c3-9258-f5f1fd95e558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a94b29b45b400aa1aad403beecbc28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.065001 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1454/2898] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:16 2022] DELETE /identity/v3/users/a5a94b29b45b400aa1aad403beecbc28 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:17.332226 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:17.333736 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:17.347861 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8b29-68fb-4795-ad0f-2609ac70fa8f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:17.405253 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:17.406122 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.407053 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.407330 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] PATH_INFO: `/v3/projects/330f55c514eb42c49ff0214a90845eba` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.408530 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330f55c514eb42c49ff0214a90845eba)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:17.410486 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.458638 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330f55c514eb42c49ff0214a90845eba', 'request_id': 'req-983bdd5d-483a-45dc-abda-2531448031e3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.466898 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330f55c514eb42c49ff0214a90845eba', 'request_id': 'req-983bdd5d-483a-45dc-abda-2531448031e3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.473616 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330f55c514eb42c49ff0214a90845eba', 'request_id': 'req-983bdd5d-483a-45dc-abda-2531448031e3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.485733 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] The token cache is being invalidate because project 330f55c514eb42c49ff0214a90845eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:17.486027 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.486721 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-983bdd5d-483a-45dc-abda-2531448031e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:17.488315 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1445/2899] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:17 2022] DELETE /identity/v3/projects/330f55c514eb42c49ff0214a90845eba => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:17.493327 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f9c3-c6ee-4993-84bd-2faf6d1a5dbd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.493796 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f9c3-c6ee-4993-84bd-2faf6d1a5dbd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.493898 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f9c3-c6ee-4993-84bd-2faf6d1a5dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.512247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0a52f9c3-c6ee-4993-84bd-2faf6d1a5dbd None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:17.513390 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0a52f9c3-c6ee-4993-84bd-2faf6d1a5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:17.573659 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1455/2900] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:17.582014 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740da277-45e5-47a0-a427-5fe437d556af None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.582338 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740da277-45e5-47a0-a427-5fe437d556af None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.582621 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740da277-45e5-47a0-a427-5fe437d556af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.600393 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-740da277-45e5-47a0-a427-5fe437d556af None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:17.601593 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-740da277-45e5-47a0-a427-5fe437d556af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:17.609775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1446/2901] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:17.613775 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f9c3-c6ee-4993-84bd-2faf6d1a5dbd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:17.623485 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f9c3-c6ee-4993-84bd-2faf6d1a5dbd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:17.628521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:17.629174 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.629457 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.629733 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.630488 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:17.630792 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:17.632378 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.644419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1456/2902] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:17.648731 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740da277-45e5-47a0-a427-5fe437d556af None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:17.658140 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740da277-45e5-47a0-a427-5fe437d556af None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:17.662955 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:17.663608 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.663897 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.664176 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.664886 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:17.666844 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.670961 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:17.693956 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1447/2903] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:17 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:17.698118 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:17.708445 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7892-1cbc-4411-a989-ee2af4d661da admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:17.765279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:17.766494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.766777 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.767053 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.767738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:17.769631 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.788780 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1457/2904] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:17 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:17.792799 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:17.802975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bf100-051d-42dd-ab72-d6f5ba1a45bc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:17.807518 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:17.808177 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.808455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.808728 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.809456 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:17.811103 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.821484 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1448/2905] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:17.825323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:17.835738 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed23ba-fb1e-41ee-892f-4d90e1aa399c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:17.840322 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde6732-196e-404c-bb40-2c5c1f1c230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:17.840964 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6732-196e-404c-bb40-2c5c1f1c230c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.841245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6732-196e-404c-bb40-2c5c1f1c230c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.841520 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6732-196e-404c-bb40-2c5c1f1c230c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.842274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde6732-196e-404c-bb40-2c5c1f1c230c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:17.843896 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde6732-196e-404c-bb40-2c5c1f1c230c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.853935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1458/2906] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:58:17.858046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:17.868460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d019-7124-4084-ba60-7a8b042a323a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:17.873254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:17.874191 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.874481 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.874764 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] PATH_INFO: `/v3/projects/57d8e8b07874421a888627c1b678e46e/users/2b4680d9362f4e708f0abdf23a985154/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.889708 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d8e8b07874421a888627c1b678e46e, user_id=2b4680d9362f4e708f0abdf23a985154, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:17.893046 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:17.906218 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1449/2907] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:17 2022] PUT /identity/v3/projects/57d8e8b07874421a888627c1b678e46e/users/2b4680d9362f4e708f0abdf23a985154/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:17.917226 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850af8-0bd0-47ba-808f-0c0e773b7623 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:17.917800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850af8-0bd0-47ba-808f-0c0e773b7623 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:17.917800 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850af8-0bd0-47ba-808f-0c0e773b7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:17.944334 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cb850af8-0bd0-47ba-808f-0c0e773b7623 None None] MFA Rules not processed for user `2b4680d9362f4e708f0abdf23a985154`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:17.945552 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb850af8-0bd0-47ba-808f-0c0e773b7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:17.976667 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:18.012266 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1459/2908] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:18.017087 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:18.078524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f7db2-6717-4a55-a554-edaa2eac9f3f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:18.083056 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:18.083714 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.083996 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.084270 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.084977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:18.087090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:18.111693 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1450/2909] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:18 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:18.115690 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850af8-0bd0-47ba-808f-0c0e773b7623 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:18.127467 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850af8-0bd0-47ba-808f-0c0e773b7623 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:18.183495 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:18.184165 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.184448 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.184722 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.185421 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:18.187328 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:18.208665 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1460/2910] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:18 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:18.212705 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:18.223089 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ba23-f167-4643-a376-94b32aefc1e5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:18.227800 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:18.228463 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.228781 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.229063 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.229804 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:18.231478 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:18.242921 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1451/2911] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:18.247042 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:18.257649 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab63b4-5ead-458c-a8f0-5ea9f8769794 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:18.262529 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:18.263411 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.263695 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.263969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] PATH_INFO: `/v3/projects/e244fc69e680462ea4a59442c74cd317/users/3c246a03077742c79223d3e1051d4c2f/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.278752 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e244fc69e680462ea4a59442c74cd317, user_id=3c246a03077742c79223d3e1051d4c2f, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:18.281312 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:18.293944 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1461/2912] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:18 2022] PUT /identity/v3/projects/e244fc69e680462ea4a59442c74cd317/users/3c246a03077742c79223d3e1051d4c2f/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:18.298460 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:18.308729 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d576c-929b-495d-8311-7f354c92e6eb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:18.366143 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35a731-ddd6-46c5-975c-e2d42b15a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:18.366835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a731-ddd6-46c5-975c-e2d42b15a5bd admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.367116 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a731-ddd6-46c5-975c-e2d42b15a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.367386 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a731-ddd6-46c5-975c-e2d42b15a5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.368105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35a731-ddd6-46c5-975c-e2d42b15a5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:18.369682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35a731-ddd6-46c5-975c-e2d42b15a5bd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:18.380328 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1452/2913] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:18.384558 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:18.395169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566d2ff-c537-4949-872b-e28ecd8108ab admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:18.399882 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:18.400773 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.401056 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.401333 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] PATH_INFO: `/v3/projects/e244fc69e680462ea4a59442c74cd317/users/3c246a03077742c79223d3e1051d4c2f/roles/d250c98aac41424fb8b1372e642d0f30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.403379 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e244fc69e680462ea4a59442c74cd317, user_id=3c246a03077742c79223d3e1051d4c2f, role_id=d250c98aac41424fb8b1372e642d0f30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:18.406008 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:18.417018 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1462/2914] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:18 2022] PUT /identity/v3/projects/e244fc69e680462ea4a59442c74cd317/users/3c246a03077742c79223d3e1051d4c2f/roles/d250c98aac41424fb8b1372e642d0f30 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:18.427812 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed10eb-b3a1-4407-9d4b-5c26dfe1e5e8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.428318 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed10eb-b3a1-4407-9d4b-5c26dfe1e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.428413 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed10eb-b3a1-4407-9d4b-5c26dfe1e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.454032 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-00ed10eb-b3a1-4407-9d4b-5c26dfe1e5e8 None None] MFA Rules not processed for user `3c246a03077742c79223d3e1051d4c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:18.455307 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-00ed10eb-b3a1-4407-9d4b-5c26dfe1e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:18.465149 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:18.528671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1453/2915] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:18.540669 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:18.542447 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:18.605285 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1e066-f207-4167-b49b-06438ea38b4a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:18.609279 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee02f1-b217-4cc7-a6f2-940805eae1ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:18.610603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee02f1-b217-4cc7-a6f2-940805eae1ef service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:18.610889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee02f1-b217-4cc7-a6f2-940805eae1ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:18.611168 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee02f1-b217-4cc7-a6f2-940805eae1ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:18.620726 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee02f1-b217-4cc7-a6f2-940805eae1ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:18.622163 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee02f1-b217-4cc7-a6f2-940805eae1ef service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:18.631591 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1463/2916] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:19.170666 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed10eb-b3a1-4407-9d4b-5c26dfe1e5e8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:19.232750 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed10eb-b3a1-4407-9d4b-5c26dfe1e5e8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:19.237222 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:19.238088 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:19.238400 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:19.238676 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] PATH_INFO: `/v3/users/2b4680d9362f4e708f0abdf23a985154` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:19.239871 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4680d9362f4e708f0abdf23a985154)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:19.241784 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:19.286271 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4680d9362f4e708f0abdf23a985154'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.286977 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4680d9362f4e708f0abdf23a985154'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.293798 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4680d9362f4e708f0abdf23a985154'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.294455 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4680d9362f4e708f0abdf23a985154'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.301417 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4680d9362f4e708f0abdf23a985154'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.318830 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1454/2917] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:19 2022] DELETE /identity/v3/users/2b4680d9362f4e708f0abdf23a985154 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:19.323401 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:19.323636 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:19.323910 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:19.341959 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:19.343189 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:19.362765 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:19.402934 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1464/2918] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:19.412613 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:19.414121 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:19.447180 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:19.475652 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb8fbb-a1a7-4e6d-864b-d07760c523f2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:19.479540 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:19.480248 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:19.480810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:19.480810 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:19.490962 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:19.492398 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:19.502077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1455/2919] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:58:19.771255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:19.772932 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:19.786841 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0bafb-e246-4b1b-8e94-bcc94205013f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:19.791585 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:19.792550 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:19.792912 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:19.793265 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] PATH_INFO: `/v3/projects/57d8e8b07874421a888627c1b678e46e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:19.794503 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d8e8b07874421a888627c1b678e46e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:19.796412 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:19.843089 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d8e8b07874421a888627c1b678e46e', 'request_id': 'req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.849783 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d8e8b07874421a888627c1b678e46e', 'request_id': 'req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.857968 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d8e8b07874421a888627c1b678e46e', 'request_id': 'req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.871554 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] The token cache is being invalidate because project 57d8e8b07874421a888627c1b678e46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:19.871886 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.872502 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.874070 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1465/2920] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:19 2022] DELETE /identity/v3/projects/57d8e8b07874421a888627c1b678e46e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:19.878057 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:19.887489 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef6e72-3f16-4506-9a35-8ed27668f2c7 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:19.943380 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:19.944251 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:19.944533 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:19.944803 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] PATH_INFO: `/v3/users/3c246a03077742c79223d3e1051d4c2f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:19.945971 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c246a03077742c79223d3e1051d4c2f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:19.947916 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:19.993756 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c246a03077742c79223d3e1051d4c2f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:19.994412 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c246a03077742c79223d3e1051d4c2f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.001061 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c246a03077742c79223d3e1051d4c2f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.001671 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c246a03077742c79223d3e1051d4c2f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.009548 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf979e2a-3943-4992-a801-f51148eccbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c246a03077742c79223d3e1051d4c2f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.026636 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1456/2921] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:19 2022] DELETE /identity/v3/users/3c246a03077742c79223d3e1051d4c2f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:20.297054 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.298538 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:20.311603 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5d08-1fe6-484c-9e0e-7bef9314e3ad admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.367919 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.368689 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.368973 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.369252 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] PATH_INFO: `/v3/projects/e244fc69e680462ea4a59442c74cd317` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.370478 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e244fc69e680462ea4a59442c74cd317)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.372374 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.418419 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e244fc69e680462ea4a59442c74cd317', 'request_id': 'req-da85bc91-171a-4105-95c3-4f176e95e57f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.420274 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:20.424768 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e244fc69e680462ea4a59442c74cd317', 'request_id': 'req-da85bc91-171a-4105-95c3-4f176e95e57f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.431169 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e244fc69e680462ea4a59442c74cd317', 'request_id': 'req-da85bc91-171a-4105-95c3-4f176e95e57f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.442694 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] The token cache is being invalidate because project e244fc69e680462ea4a59442c74cd317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:20.442979 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.443592 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-da85bc91-171a-4105-95c3-4f176e95e57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.445126 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1466/2922] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:20 2022] DELETE /identity/v3/projects/e244fc69e680462ea4a59442c74cd317 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:20.450202 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dcd10-8165-4a21-a0f2-1d0f55091257 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.450746 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dcd10-8165-4a21-a0f2-1d0f55091257 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.450842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dcd10-8165-4a21-a0f2-1d0f55091257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.469914 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-024dcd10-8165-4a21-a0f2-1d0f55091257 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:20.471274 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-024dcd10-8165-4a21-a0f2-1d0f55091257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:20.515704 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:20.532509 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1457/2923] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:20.542013 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a25cc0-f42a-4d15-ac4e-0412a526d493 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.542330 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a25cc0-f42a-4d15-ac4e-0412a526d493 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.542610 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a25cc0-f42a-4d15-ac4e-0412a526d493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.560794 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e1a25cc0-f42a-4d15-ac4e-0412a526d493 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:20.561983 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e1a25cc0-f42a-4d15-ac4e-0412a526d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:20.570454 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1467/2924] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:20.574658 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dcd10-8165-4a21-a0f2-1d0f55091257 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.584806 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dcd10-8165-4a21-a0f2-1d0f55091257 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.589254 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.589905 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.590234 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.590488 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.591213 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:20.591520 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.593105 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.604450 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1458/2925] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:20.608862 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a25cc0-f42a-4d15-ac4e-0412a526d493 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.618209 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a25cc0-f42a-4d15-ac4e-0412a526d493 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.622893 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.623576 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.623861 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.624140 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.624877 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.626801 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.652687 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1468/2926] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:20 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:20.656883 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.667604 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1c63f-302e-4d45-9422-e9aace7ba1da admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.723227 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.723922 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.724216 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.724494 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.725192 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.727169 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.747243 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1459/2927] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:20 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:20.751947 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.767017 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9feecc-0d80-443b-964e-4c9578566210 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.772373 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.773040 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.773323 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.773601 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.774360 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.776003 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.786472 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1469/2928] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:20.790465 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.800868 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9fb85-b56e-44e8-9daa-a01cf53efdee admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.805747 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0081ea-3798-46cb-a27a-33fced74af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.806466 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0081ea-3798-46cb-a27a-33fced74af48 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.806785 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0081ea-3798-46cb-a27a-33fced74af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.807066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0081ea-3798-46cb-a27a-33fced74af48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.807832 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0081ea-3798-46cb-a27a-33fced74af48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.809469 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0081ea-3798-46cb-a27a-33fced74af48 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.820911 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1460/2929] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:20.825012 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.835507 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367c1a-ccbb-4e42-b805-b7e4b2355cf3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.840098 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.840969 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.841247 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.841521 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] PATH_INFO: `/v3/projects/4a1967661fef43de8d4c437af5860f8c/users/6fa1ebc48ac04f7ab2ced27a3947caed/roles/f0335c15ec8744d9bbe266c5df640a34` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.856184 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1967661fef43de8d4c437af5860f8c, user_id=6fa1ebc48ac04f7ab2ced27a3947caed, role_id=f0335c15ec8744d9bbe266c5df640a34)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.859241 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.872026 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1470/2930] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:20 2022] PUT /identity/v3/projects/4a1967661fef43de8d4c437af5860f8c/users/6fa1ebc48ac04f7ab2ced27a3947caed/roles/f0335c15ec8744d9bbe266c5df640a34 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:58:20.883388 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860742ff-48fe-44a8-8d51-dd4addf13657 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.883701 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860742ff-48fe-44a8-8d51-dd4addf13657 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.883975 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860742ff-48fe-44a8-8d51-dd4addf13657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.911523 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-860742ff-48fe-44a8-8d51-dd4addf13657 None None] MFA Rules not processed for user `6fa1ebc48ac04f7ab2ced27a3947caed`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:20.912757 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-860742ff-48fe-44a8-8d51-dd4addf13657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:20.975807 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1461/2931] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:20.987088 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.989255 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:21.048901 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5f2b-b9b1-40e9-b373-fe6a7eec7b63 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:21.053086 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d932b-813e-4a58-a5b9-bb128722500c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc3534120be42ce9bc7ebb6f2a8fbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:21.053724 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d932b-813e-4a58-a5b9-bb128722500c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:21.054004 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d932b-813e-4a58-a5b9-bb128722500c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:21.054308 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d932b-813e-4a58-a5b9-bb128722500c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:21.062696 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d932b-813e-4a58-a5b9-bb128722500c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:21.064105 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d932b-813e-4a58-a5b9-bb128722500c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:21.075494 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1471/2932] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:30.972888 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:31.071367 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=58,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:59:06.359010 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860742ff-48fe-44a8-8d51-dd4addf13657 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:59:06.427284 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860742ff-48fe-44a8-8d51-dd4addf13657 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:59:06.431835 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:59:06.432709 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:59:06.432986 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:59:06.434646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] PATH_INFO: `/v3/users/6fa1ebc48ac04f7ab2ced27a3947caed` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:59:06.434646 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa1ebc48ac04f7ab2ced27a3947caed)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:59:06.436415 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:59:06.489363 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa1ebc48ac04f7ab2ced27a3947caed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:06.492080 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa1ebc48ac04f7ab2ced27a3947caed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:06.502077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa1ebc48ac04f7ab2ced27a3947caed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:06.502077 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa1ebc48ac04f7ab2ced27a3947caed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:06.510854 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa1ebc48ac04f7ab2ced27a3947caed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:06.531066 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1462/2933] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jul 21 10:59:06 2022] DELETE /identity/v3/users/6fa1ebc48ac04f7ab2ced27a3947caed => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:59:06.537109 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:59:06.537598 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:59:06.537703 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:59:06.558556 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] MFA Rules not processed for user `0eb3ee29f72e4aaaa17cfa0dfe2cba0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:59:06.559803 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:59:06.632909 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1472/2934] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jul 21 10:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:59:06.645513 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:59:06.648434 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:59:06.738078 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0a31-2dda-48ee-ae04-af87188f8205 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:59:06.746775 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc579eaf4c3e4ea5a77063ba5f3d4b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:59:06.747524 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:59:06.747842 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:59:06.748231 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:59:06.759841 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:59:06.762724 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:59:06.774582 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1463/2935] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:59:07.065536 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:59:07.067216 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:59:07.080345 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b9cc-8cbf-4f3c-a4a1-d5e4fe027228 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:59:07.085889 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb3ee29f72e4aaaa17cfa0dfe2cba0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c2ba687ad420a81f045d494e495c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:59:07.086823 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:59:07.087112 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:59:07.087391 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] PATH_INFO: `/v3/projects/4a1967661fef43de8d4c437af5860f8c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:59:07.088671 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1967661fef43de8d4c437af5860f8c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:59:07.090646 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:59:07.140363 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1967661fef43de8d4c437af5860f8c', 'request_id': 'req-58db9179-2006-4d99-9dd4-db5a8f5f319b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:07.146702 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1967661fef43de8d4c437af5860f8c', 'request_id': 'req-58db9179-2006-4d99-9dd4-db5a8f5f319b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:07.152475 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1967661fef43de8d4c437af5860f8c', 'request_id': 'req-58db9179-2006-4d99-9dd4-db5a8f5f319b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:07.165634 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] The token cache is being invalidate because project 4a1967661fef43de8d4c437af5860f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:59:07.165935 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:07.166677 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-58db9179-2006-4d99-9dd4-db5a8f5f319b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:59:07.168245 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1473/2936] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jul 21 10:59:07 2022] DELETE /identity/v3/projects/4a1967661fef43de8d4c437af5860f8c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:59:16.769620 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:59:17.162413 dv-cinder-850618-1-iscsi devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:03:10.628090 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 11:03:10.629477 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 11:03:10.742682 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d530af-b910-42d3-96ea-e3a89f0d923d service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 11:03:10.800700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6704-0e4a-4093-b676-5d45aa1baf12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1493c0e47d2452ba971464c7d0be294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302e0852b0af4faf94dc9383d5b47175', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 11:03:10.801364 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6704-0e4a-4093-b676-5d45aa1baf12 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 11:03:10.802327 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6704-0e4a-4093-b676-5d45aa1baf12 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 11:03:10.802607 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6704-0e4a-4093-b676-5d45aa1baf12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 11:03:10.804425 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-056f6704-0e4a-4093-b676-5d45aa1baf12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 11:03:10.815700 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6704-0e4a-4093-b676-5d45aa1baf12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 11:03:10.817324 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6704-0e4a-4093-b676-5d45aa1baf12 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 11:03:10.827294 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1464/2937] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jul 21 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 11:03:20.822994 dv-cinder-850618-1-iscsi devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=76 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}